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COMPLEXITY OF TEST ITEMS AS A FACTOR IN THE 
VALIDITY OF MEASUREMENT* 
Dove tas E. Scates 
Director of School Research, Cincinnati 

Some tests are given for the purpose of measuring rather simple 
abilities; others are given to measure more elaborate abilities. What- 
ever the degree of complexity of the ability to be measured, it is desirable 
that the measuring instrument contain tasks which have a corresponding 
degree of complexity, if variations in the ability are to be faithfully 
represented in the measurements. We do not overlook the fact that prac- 
tical considerations often necessitate the use of some more simple or 
perhaps more complex form of response which correlates sufficiently well 
with the ability to be measured so that approximate measurements can 
be secured. It is well known that many different kinds of performance 
bear a substantial correlation with each other, so that many tasks of 
different degrees of complexity are likely to have a substantial relation- 
ship. There is, however, considerable loss in such indirect indexing, and 
the desire for a high degree of validity in measurement usually calls for 
something more than a dependence upon intercorrelations between abili- 
ties. It is the purpose of this paper to examine the demands that validity 
makes upon the complexity of test items for the measurement of various 
kinds of ability. 

By complexity is meant the number of factors which enter into the 
response to a test item, and the interrelationships which exist between 
ese factors. In the ease of a test of mental performance, complexity 
relates to the thought structure of the response, including perhaps the 
initial seleetion of factors which should be responded to. In other words, 
complexity depends upon the number of significant variables ‘that are 
required for a satisfactory response, and on the pattern of their inter- 
relationships. We have searecely as yet arrived at the point where we 
ean say with confidence how many important variables there may be in 


Read before the American Educational Research Association at Cleveland, Feb- 
27, 1934. 
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a response, or exactly what their nature and relationships are, but it n 
nevertheless be profitable to discuss the matter in general terms. Defi 
consideration of this aspect of test items may throw a somewhat diff 


light on the construction of ‘‘ just ordinary’’ tests as well as stand: 


tests, and may possibly lead to a somewhat different emphasis in eyaly 


ating tests. 

Although we are concerned primarily with the character of the 
sponse which is made to a test, it becomes necessary for the test m: 
to turn his attention to the test items and to evaluate them in the lig 
the kind of response they will normally stimulate. We shall there! 
apply the term complexity to test items as well as to responses—m 
ing that the test item must be appropriately complex to stimulate 
sponse of the desired complexity, in so far as the test item is depe: 
upon as the significant stimulus. While the matter of appropriate , 


plexity of test items is one that is not ordinarily ignored entirely, it js 


typically dealt with only incidentally, and not directly. That is, the t 
maker commonly selects a particular bit of ‘‘knowledge’’ and easts 
into a form which he deems appropriate for an item in his test. 1 
complexity which the item may have is determined mainly by th 
acter of the test which is being constructed, and not by careful att: 
to this particular aspect of the item. It is more or less taken for gran 
that all items of the same type are of the same complexity. 

If the test is being made by the research worker, he will of « 
analyze his test items statistically, but that is likely to lead only t 
casting out of items which do not seem to be as good as others: it d 
not improve those which are left. Hence, the test in its final form is 
likely to be appreciably better than a group of the best items as orig 
constructed. It is therefore worth while to give some thought to m 
by which the quality of test items may be improved at the outset, ar 
giving of definite attention to the matter of complexity is suggested 
supplement to the present general emphasis upon selection of 
Moreover, in the case of the common teacher-made test, such an em; 
is particularly important, for in these tests items are usually no 
selected. 

The general concept of complexity of measurement will be dev: 
first by reference to simple situations in the field of physical m 
ment, where the relationships can be readily seen, and subsequent 
calling attention to its application in the field of educational m« 
ment. Turning our attention to a simple illustration from the physi 
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we may note the difference between linear measurement, square 
irement, and eubie measurement. These are three different kinds of 
rement beeause they differ in the number of factors (planes, di- 
ms, or variables) which are included in them. In fact, even though 
ay all be expressed as functions of distance, one system of measure- 
may not be transformed into the other without the addition or 
tion of one or more factors. When a seventh grade girl recently 
er teacher, ‘‘How many square feet are there in a eubie foot?’’ 
led to recognize that differences in the degree of complexity of 
nes of measurement involved rendered her question unanswerable. 
rements having different degrees of complexity (that is, repre- 
« different numbers of factors, such as linear, square, and cubic 
sure) are regarded as constituting fundamentally different systems 


/ 


mensuration. 

be noted at once that any one of these types of measurement is 
ropriate for measuring outside of its own field. Linear measure- 
| not suffice for area, and square measurement will not suffice for 
The content of a two-foot cube is not two or four times that 
ne-foot eube, but eight times. It is of course true that we are some- 
es satisfied with measurements that are deficient in some of the factors 
we desire to be present. For example, we might be satisfied to 
ire only the length of a number of boxes, when we were really 
ested in their volume, though it is obvious that we would be con- 
z ourselves with very rough suggestions as to actual or relative 
We commonly are content to indicate the length of a book by 
imber of pages which it contains, knowing full well that the number 
ords on a page will vary with the size of the page, the size of the 
nd several other factors. We may be satisfied, as a first indica- 
with knowing the number of rooms in a house; but we usually 
to follow this erude type of measurement with information con- 
ng the area of the rooms, their shape, and the pattern in which they 
rranged to make up the house. Just how closely the complexity of 
easurement need follow the complexity of the character which it 
ired to measure is a matter which is in all cases dependent upon 
purpose; but it may be suggested as a general principle that it is 
‘ safe to ignore factors unless one knows pretty well their effect 

the significance of the measurements which he obtains. 
It is perhaps desirable to eall attention at this point to the distinction 
relevant and irrelevant factors in measurement. All measure- 
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ment is of course highly selective, disregarding many aspects of th 
objects which are not desired to be included in the measurement. |; 
the case of boxes, for example, if one is interested in measuring volum 
he will not inelude in his measurements such factors as the kind of wood 
its color, its thickness, its moment of rupture, its specifie gravity, ete 
Excluding such irrelevant characteristics, however, is a different matte: 
from excluding factors which constitute essential elements in the gener; 
character which one is seeking to measure. In measuring volume 0) 
cannot normally omit with impunity any of the three relevant factors 
of length, breadth, or depth. Whether a factor is relevant or not is o 


course dependent upon one’s purpose 


we may be interested in thickness 
of wood rather than in volume. In considering the complexity of measur 
ment which is appropriate, therefore, one needs to distinguish betwee 
those factors which are essential to his purpose and those which an 
irrelevant. 

It is not always easy, even in the field of physical measurements, ti 
identify and provide for all of the factors which should be measured. A 
somewhat more complex illustration may serve to show this. Some years 
ago the statement was made that people would help avoid traffic conges 
tion if they would ride street ears. The argument advanced was that wher 
the length of a street ear was divided by the number of people it wo 
hold each person was found to require only about one-fifteenth as man 
feet as he did in an automobile. Without any immediate interest in th 
correctness of the statement, it might be pointed out that the eompariso 
which was used ignored at least four important factors which should bv 
taken into consideration before the figure could take on real significance 
First, square feet, or perhaps ‘‘lane-feet,’’ should be used instead 
linear feet, since many highways provide for more than one traffie lan 
Second, the linear distance which must be preserved between vehicles 
is perhaps more important even than the length of the vehicle itself 
Third, the comparison used the maximum load for a street ear and f 
minimum load for an automobile; the average load for both, at the rus! 
period, should have been used. Fourth, congestion is in part a matter 


of average rate of travel, taking stops into consideration. There are oth 
less important factors. The figure used, representing only linear 
per person, could not have much significance when a figure giving lan: 
feet per person per mile per hour, on the average, contained the minimun 
number of important factors. 
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f th i thematically minded person would say that the unit required 
In : roblem was multi-dimensional. This is not a common term in 
lame edi. but it is a suggestive one. It means that, instead of being 
vood ex], le in terms of two or three dimensions, such as area and volume 
, etc Im ature of the thing to be measured is so complex as to require 
atten nensions, or factors, in the measurement. It is somewhat difficult 
ner: | one’s thinking into dimensions beyond the third, and this is of 
> OF nse only a mathematical figure of speech. It may, however, be sug- 
eto to think of a jewel cut with many irregular facets, each one having 
is ¢ peculiar shape. One can readily see that only a very imperfect 
knes tion of the stone could be obtained by viewing it from any single 
sur To reveal the true shape of each facet would require a plane 
wee! el to it, making as many planes as there were sides. If each such 
1 an or dimension is thought of as representing a separate variable in 
i| deseription of the stone, the need for many of them can be 
ts. ty eciated. 
it lhe foregoing illustrations have been drawn from the physieal fields 
vears ‘+h the appropriateness of a certain degree of complexity in the 
nes rement is obvious. But it should be equally clear that in psy- 
wh vical fields measurement must also be appropriately complex. In 
0 n behavior we are likely to find more significant factors, and a more 
nal licated interrelation of these factors, than we are in physieal fields. 
nthe ctors in psychological work are also less generally recognizable, so 
risi s difficult to ascertain just what ones should be ineluded. It 
ld he ns certain, however, whatever the difficulty involved in securing 
ane ctory measurement, if we attempt to measure complicated psy 
d ‘al response tendencies with measuring instruments whieh are 
lane too simple er too complex for our particular purpose, we eannot 
icles to get a pieture that wil! reveal the true conditions of those 
tsi ters which we desire to study. 
1 ttempt a list of the various factors which may condition a human 
rus is not within the scope of this paper. We shall, however, refer 
atte general groups of factors for purposes of illustrating different 
rt} it complexity in psychological measurement. We may refer to 
ef ee groups simply as intellectual, environmental, and personal. 
lane rst group, the intellectual factors, will be ineluded the abilities 
min es which are commonly tested in our ordinary tests. If one 


terms of objective tests, including most of the standardized 
mereially available, he will think chiefly of knowledge of facets, 


to 


including a certain proportion of relationships of various kinds, most 


which have been studied as factual relationships. The informal t 
made tests of the objective type also abound in this type of item. 
It would be profitable if teachers and other test makers would u 


take a psychological analysis of the complexity of the processes re 


to make a proper response to the more common test items, and comp 


their findings with the complexity of the types of mental activity 


they commonly assert they are teaching to develop. It seems pro! 


that we are on the whole attempting to measure very complex ty 


intellectual learning with very simple tasks. For example, we ascert 


whether a pupil ean respond to a ‘‘knowledge’’ item without comn 
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expressing any interest or coneern over what this knowledge may 1 


to the pupil. There is an infinite variety of kinds and degrees of 


tionships between specifie response tendencies (such as ‘‘knowled: 


and the hackground of thinking and use into which they fit. The m 


ment of these more complex processes ealls for amany factored eompi 


within the test items which are used. Even in those sehools whic! 


content to have their teaching follow along the traditional line of 


phasis almost exclusively upon intellectual aspects of learning, t 
still a great opportunity to improve the type of testing which is 
monly done. 


her 


Countless tests that are given to measure intellectual achiever 


eonsist of rather simple reeall or identifieation items of various |! 


sole lv hee use it has hecome fashionable to vive tests of this eha 


and not beeause anyone ean justify them as appropriate measur 


the objectives of edueation to which most teachers will at least 
lip service. The mental processes commonly measured are of the 
simplest kind, and are of relatively superficial significance as indi 
of real growth when edueation is looked at in the large. One s 
examine the objective tests which he has used during the past y 
see how many items in the course of a vear have actually requir 
ability to make generalizations, to apply general principles, to dt 

ferences, to detect similarities and differences, to evaluate, to appr’ 
to detect eause and effect relationships, to marshal facts, to sup 
position, ete..—in areas where the facts and relationships called for 
not been taught as such. Or if one feels that an adequate underst 

of a complex subject is an important intellectual ability even wl 

rectly taught, how many of our tests, and particularly the stand: 

tests in the Social Studies—make anv apparent attempt to refl 
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nowledge of why facts are as they are? A real understanding 
for a knowledge of what factors have caused conditions to be 
yhat the relative importance of these factors is. As contrasted 
the majority of test items seek to ascertain only whether the 
n reeall some fact, which has previously been taught directly 


tated earlier, for certain purposes of measurement one may be 
to ignore those factors which cause one kind of ability to be dif- 
from another kind; but when one does so he will be careful not 
conclusions of large significance. It is somewhat difficult to be- 


it the conclusions which teachers must draw from their measure- 
} n be classed as not of large significance. It is highly dangerous 
1 ssume that we are adequately indexing intellectual achievement of 

moment when we use test items of the simpler kinds. If one is 
ed in testing the significance of a fact in the pupil’s thinking, in 


no 
| 


how many other ideas a fact is associated with in the pupil’s 
nd how it fits into a large pattern of his responses, in testing the 
ility to follow through an appropriate sequence of ideas in order 
a conclusion, in getting some insight into the pupil’s ability to 
ipon a large and varied background in order to make proper 
e\ tions, in looking into the pupil’s ability to see relationships quickly 
iterial, and in studying many other mental operations which are 
to the development of real mental power, then one will have to 
the vast array of highly mechanical, narrow test items which 
encumber educational tests at the present time, and seek out 

test items which are appropriate to one’s purpose. 

We are, however, interested in more dimensions or aspects of per- 
ce than those which are represented by intellectual ability. We 
rested in some of the factors which cause this ability to vary, or 
special forms. We are, for example, all aware from personal 
ce that we ean recall something at one time and not at another; 

ink of things to say, or we can work out solutions to problems, 

set of circumstances and not under others. We have gradually 

realize that even such an apparently simple thing as an item 

ledge is not a single thing, nor is it a constant thing; its exist- 
mtingent upon the strength of a tendency for the individual to 
in that particular way, when various conditions are stimulating 
es of other kinds. We are therefore interested in an item of 
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knowledge, or some other ability, not only under one set of condit 


but under a number of different sets of conditions. 


In this second group of factors, referred to as environment 
should inelude those kinds of stimulation which arise out of the phys 
conditions, social conditions, and perhaps the emotional set, involving 


stimulation of effort, various distractions, and confusions. The test 
be presented im such a way that all, or most of the group will respo 
a great intensity of effort, or they may engage in their tasks wit 
an indifferent attitude. There may be various physical distractions 
as noise, heat, cold, ete. The test administrator may emphasize sp 


caution, guessing or certainty, or other general attitudes. It is clea 


there may be considerable stimulation of a significant kind whic! 
arise from the test items themselves. Certain factors which ar 
in the responses may arise from the general conditions of the testing 
such, they fall somewhat outside of the present diseussion of test 
though essentially they represent an extension of the principle being 
cussed. It may be profitable to give some attention to them in pass 
Especially important in this second group of factors which co 
responses are certain types of social stimuli, particularly thos 
enter into social performance. As teachers, we sometimes fail t 
nize the differences which obtain between responses under form 
room conditions and responses under more normal social conditions 
example, it is a rather common experience for one to find that his 
metie does not function as well under typical conditions of life as it 
in the elassroom. When, for example, one is buying potatoes 
grocery store priced at twenty-five cents for fifteen pounds, and on 
only fifteen cents worth, he may want to know how many po 
scales should show in order for him to get his share. He knows 1 
problem is simple, if he were only baek in school, or baek hom 
is not simple when he must hurry to figure it out before the grocer 
the sack off the seales, and when he must have enough confide 
answer so that he will be willing to raise a question about the 
it does not agree with his mental ealeulations. There are ma) 
who ean do their formal arithmetie well, who wait until they 
from the store to see whether the storekeeper gave them the rig! 
or not, beeause they get confused in trying to count change in f 
situation and are not willing to expose their confusion by taki: 


more time. 
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uuble in all such eases, where the abstract skills have been mas- 
t that the person’s knowledge of academic arithmetic is faulty, 
that it is academic. If we assume that we are concerned with 
pment of functional skills under practical conditions, the test 
learning must be something more than the routine sort. Prob- 
test situation here becomes more important than the particular 
if the ‘‘knowledge’’ involved may be thought of as an item). 
ent of importance again is the complexity of the total stimula 
n, and it is rather difficult to distinguish that part of the 
which should be thought of as originating primarily in some- 
responding to a particular test item, from that part of the 
n which should be thought of as growing out of the general 
The point of trying to make such a distinction is of course 
| one only; the practieal significance of the illustrations is 
ten essential to secure a complexity of stimulation that is far 
t usually attained in our testing, if we are to measure the 
ceable aspects of some of our learning. 
ieve this complexity of stimulation not infrequently calls for 
ther than paper and pencil tests. Consider for example, the 
speak informally before an audience, involving as it does a 
of social stimuli, a disregard for many of the stimuli, and a 
relationship between attention to selected aspects of the social 
and attention to one’s purpose in speaking—all of which are in 


to the technieal or more intellectual phases of the talk, such as 


» something of significance to say, having it well organized, having 


nd of correct English usage, ete. These more general, or per- 
cademie, aspects of the individual’s total adaptation, and their 
with the more formal, more academic aspects obviously repre 
nse complexities which are far beyond the scope of typical tests 
th. They are, however, none the less important as edueational 

in fact, it may be held that if the more narrow intellectual 
learning do not deve lop into the larger abilities which are of 
mportanee in life at large there is some question about the value 
e the narrow forms of learning. At any rate, it will be appar- 
he total stimulation pattern which obtains in evervday affairs 
to be very different from that which surrounds the giving of 
sts in the elassroom. It may be worth while pausing to con 
practical validity of our measurements when based upon the 
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knowledge, or some other ability, not only under one set of condit 


but under a number of different sets of conditions. 
In this second group of factors, referred to as environment 
should include those kinds of stimulation which arise out of the pl 


conditions, social conditions, and perhaps the emotional set, involving 


stimulation of effort, various distractions, and confusions. The test 
be presented in such a way that all, or most of the group will respond 
a great intensity of effort, or they may engage in their tasks wit 
an indifferent attitude. There may be various physical distractions 
as noise, heat, cold, ete. The test administrator may emphasize sp 
caution, guessing or certainty, or other general attitudes. It is clear 
there may be considerable stimulation of a significant kind whic! 
arise from the test items themselves. Certain factors which are | 
in the responses may arise from the general conditions of the testing 
such, they fall somewhat outside of the present diseussion of test 
though essentially they represent an extension of the principle bi 
cussed. It may be profitable to give some attention to them in | 
Especially important in this second group of factors which con 
responses are certain types of social stimuli, particularly thos: 
enter into social performance. As teachers, we sometimes fail 1 
nize the differences which obtain between responses under form 
room conditions and responses under more normal social conditions 
example, it is a rather common experience for one to find that | 
metie does not function as well under typical conditions of life as 
in the classroom. When, for example, one is buying potatoes 
vrocery store priced at twenty-five cents for fifteen pounds, and « 
only fifteen cents worth, he may want to know how many po 
scales should show in order for him to get his share. He knows | 
problem is simple, if he were only back in school, or back home 
is not simple when he must hurry to figure it out before the groce 
the sack off the seales, and when he must have enough confide 
answer so that he will be willing to raise a question about the weig 
it does not agree with his mental ecaleulations. There are mai 
who ean do their formal arithmetie well, who wait until they 
from the store to see whether the storekeeper gave them the rig 
or not, beeause they get confused in trying to count change in | 
situation and are not willing to expose their confusion by taki 


more time. 


= 


+ 


"S832 468 


| 
™ 
| 
To 
| 


ond 
nent 
e 

por 
wit 
Hions 
eS 
e 

} 

re 
test 
he 

4 

ions 
} 


COMPLEXITY OF TEST ITEMS 85 


uuble in all such cases, where the abstract skills have been mas- 
t that the person’s knowledge of academic arithmetic is faulty, 
that it is academic. If we assume that we are concerned with 
ment of functional skills under practical conditions, the test 
earning must be something more than the routine sort. Prob- 
test situation here becomes more important than the particular 
if the ‘‘knowledge’’ involved may be thought of as an item). 
ent of importance again is the complexity of the total stimula 
rn, and it is rather diffieult to distinguish that part of the 
n whieh should be thought of as originating primarily in some- 
responding to a particular test item, from that part of the 
whieh should be thought of as growing out of the general 
The point of trying to make such a distinction is of course 
eal one only ; the practical significance of the illustrations is 
ften essential to secure a complexity of stimulation that is far 
usually attained in our testing, if we are to measure the 
ceable aspects of some of our learning. 
eve this complexity of stimulation not infrequently calls for 
r other than paper and pencil tests. Consider for example, the 
to speak informally before an audience, involving as it does a 
of social stimuli, a disregard for many of the stimuli, and a 
relationship between attention to selected aspects of the social 
and attention to one’s purpose in speaking—all of which are in 
to the technical or more intellectual phases of the talk, sueh as 
something of significance to say, having it well organized, having 
nd of eorrect English usage, ete. These more general, or per- 
wademie, aspects of the individual’s total adaptation, and their 
with the more formal, more academic aspects obviously repre 
onse complexities which are far beyond the seope of typical tests 
vith. They are, however, none the less important as edueational 
in faet, it may be held that if the more narrow intellectual 
learning do not develop into the larger abilities which are of 
mportanee in life at large there is some question about the-value 
¢ the narrow forms of learning. At any rate, it will be appar- 
he total stimulation pattern which obtains in evervday affairs 
he very different from that which surrounds the giving of 


sts in the classroom. It may be worth while pausing to econ 


practical validity of our measurements when based upon the 
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relatively artificial conditions affecting responses while pupils are sit 
in their seats writing, as contrasted with being out in the world 


The third group of factors which condition performance ha 
referred to as personal. In this group are included such aspects 
individual’s larger habits of life as purposes, interests, working sta) 
of performance, emotionalized attitudes, and seales of value or pr 
ences. These lie to a certain extent in the fields of personality and \ 
acter; but they also have a close relation to the intellectual aspect 

) | learning. In fact, it has been suggested that pupils study the cor 
| . school subjects primarily in order to give teachers an opportm 
| develop these orienting and dynamie aspects of the individual. W 
| ever their relative importance, there will be little question that they 
important. While more technical forms of knowledge may great); 
our material standard of living, it is the status of the traits in this 1 
group which determines the essential soundness of our society. Al 
any school principal, edueational philosopher, or commencement s] 
will declare that these are the forms of learning for which schools 1 
; exist; yet they are seldom measured at all—as though they wi 
material. 
. | There is some truth in the suggestion that we know comparativels 
| at the present time about the measurement of personality and char 
| aside from the use of somewhat questionable paper and pencil tests 
i is also true that an adequate appraisal of many of these traits must 
) upon observation rather than formal measurement. But the facts 
ease searcely justify present practices or lack of practice. Cer 
| it is possible to gather systematie information concerning pupils’ i 
concerning their use of leisure time, concerning their preference 


other tendencies, both by blanks which they fill out. and by obser 
| Further, if these traits are really as important as most edueat: 
they are it would be worth while to reorgani Aw the school eurrie! ] 
that pupils are given a large opportunity to exercise these charactt 
develop them, and exhibit them. If this is done, there will be sor 
portunity for gathering relatively significant data on the extent t 
the rather ot neral or baekeround response tend nel Ss ore present 
pupil. 
We are not here concerned, however, with making constructi 
gestions; we are concerned only with pointing out that the usu 
which are given in school leave untouched this vast field of learnin: 


is of fundamental importance. Typical test items are simply ina 


il 
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sit 
d , th these larger response patterns, many of which are working 
- ther than intellectualized habits. It seems probable that in- 
™ ests may make further progress in this field, as some already 
= e; but for the present we must look upon our routine achieve- 
— sts—which constitute the great bulk of the testing that is now 
nd che fn s representing a very small segment of the total learning which 
= striving to cultivate. They simply do not possess the complexity 
- te to stimulate those response factors which we are interested 
T we look at life in the large. 

W Ve may turn our attention from these several groups of factors which 
they te to varying degrees of complexity in response tendencies, to 
thy several questions which arise with reference to the complexity 
Lis tems. Perhaps the question first to arise concerns the justification 

Alt w or specific measurements for certain purposes. It must of 
S] be recognized that there are purposes in education which eall for 
Is 1 the 1 wing of less complex abilities. One may, for example, want to 
7 speed of reading, vocabulary knowledge, word recognition, the 

to get the general meaning of a paragraph, etc., as separate and 
ly litt spects of reading. Such is usually the case where we are interested 
; osis, and one is interested in such aspects for purposes of guiding 
sts ictional emphasis. It is true also that recent scientific work in 
ust ement has been directed toward the securing of more specific, 
s int mple, measuring units. 
ert Two things should be said about measuring simple educational out- 
In the first place, it is unfortunate for any teacher to become so 
A tentive to the narrower aspects of a subject that she fails to give ade- 
rval te emphasis to the larger outcomes in that field. In reading, for 
, it is of great importance that the child from the very start make 
; not only in the mechanics of reading, where tests are numerous, 
eris! in such phases as good taste in his preferences for material to 


preciation or enjoyment in reading, the habit of reading for 

| and for intellectual gain, a concept of a balanced program of 
reading, and the like. Such considerations lessen somewhat the 

importanee of narrow measurements. Without any thought of 

ng such measures when properly used, it is a matter of com- 

ervation that they are grossly overemphasized, and when so used 

direct the teacher’s attention away from the larger outcomes, 


s serve a very questionable purpose. 


‘ 
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In the second place, it should not be lost sight of that the ing 
provided by narrow measurement becomes much more valuab| 
adequate general measures of the ability as a whole are available, to 
a picture of the pattern of articulation between the detailed aspects. 


is, it is possible in teaching to emphasize one aspect and then anot! 


the general ability, as specific tests reveal that one and anothe: 


is weak, and when all of these have been given due attention. w 
still have a learning product that is wholly unsatisfactory. We : 


never lose sight of the fact that a particular ability ealls for an 
relation of many aspects which is just as important in a mental or s 
ability as coérdination is in muscular performance. Mechanieal t 
may be taken apart and put together again more or less at will; 
products on the other hand eventuate over a period of time as thie 1 
of a continuous process of inter-adjustment between the various sig 
cant factors. Such produets are too complex to be adequately dealt 
in terms of their separate aspects, for the element of structural pat 
is aS important in a growth product as are the different ind 
elements which enter into this pattern. It follows that there is 
bility that the development of separate aspects of a skill seriatim 
far as such might be possible) might result in a net education 
In so far as we have appropriate general tests for our school su 
in which the tests call for appropriately complex responses, thes 
be used as measures of real progress, to keep the teacher from t 
too much in terms of piecemeal instruction devoted to one aspe 
subject at a time. Teaching is a very delicate art which may eas 
thrown off balance by testing which is not well oriented. 

One may raise the question as to why it is not better to s 
measure of a total ability through putting together detailed measure: 
of its many aspects. This is practically another form of the questio: 
dealt with. The structural pattern of the interrelation among 
specific aspects may be much more important than one or all 
aspects taken individually. For example, it would be quite possi! 
an individual to have all of the supporting skills that enter int: 
speaking well developed and still be almost a complete failure as as 
Of course it is not likely that one would develop these aspects in iso! 
but neither is it likely that he will, under normal school conditi: 
velop them in proper relationship. As a very simple instance, 
note that people have on the whole made those general adapta‘ 
their environment which enable them to manage their hands with 
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ttention; yet how many of these people can stand before a sizeable 
vithout being embarrassed by the fact that their hands are receiv- 
oo much of their own attention and that they cannot find anything 
riate to do with them? The skills, or adaptations, which we have 


not in one set of circumstances, are readily disrupted and rendered 
er as s by some slight change in one’s relation to his environment—such 
we Bas moving from one’s seat in a group to a position in front of the 
We 

an 'o talk about developing each of the aspects of an ability separately, 
or § suring them separately (which often leads to an attempt to develop 
al t , | separately) is to overlook entirely the faet that an ability is the 
; 2 t of an adaptive growth, and comes about through the establishment 
he reuil f many interrelations that are of the greatest importance. We may be 
IS sig » to discover deficiencies in certain aspects of an ability by specific 
ealt measurement but we cannot by such measurement discover the deficiencies 
nay exist in the relationships between the aspects. It is not possi- 
id to develop such aspects as formal skills, adaptation to situations, and 
Ra tation to purpose, In properly integrated form, by developing each of 
m these aspeets separately, and if they are measured separately, we do not 
m whether they fit together into a desirable general pattern or not. 
sul Effective speaking, effective writing, effective thinking, and many other 
hese mplex abilities, including perceptual skills, have composite aspects 
cannot in any way be touched by considering simple analyzable 

rect spects separately. 
eas There is a further question that may be raised. That is the question 
ether complexity of measurement should not be sought in the test 
st :a whole, rather than in the items individually. It may be argued, for 
are! nple, that a test should consist of a good many items on each topie, 
tior that if these items are varied in form the test as a whole will reflect 
’ aspects of knowledge about the topie and hence will achieve the 
I e of complexity desired. This question must be considered in several 
In the first place, it must be recognized that a simple increase in 
c t mber of items does not in itself increase the complexity of the 
§ ‘al measurement, at least in the sense here being discussed. We may 
sol e the thoroughness with which we explore the knowledge of any 
using more test items; but if these items are homogeneous we 
thereby increase the number of factors represented in the total 
it ions rement except in the sense that each separate mental stimulus may 


out | to be a different factor. 


“ + 
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It is, as it were, taking more measurements in the same plane, 
than increasing the number of planes or dimensions which are repr: 
in the measurement. Referring to a physical example, it is like measy 
only the height of more and more boxes, when one may really desir 
know the volume of the boxes. In this case the number of factors is | 
creased only in the sense that we think of some different factor as causin: 
each box to be a different height; but clearly no number of measuren 
of height, however great, would ever give us a measure of the volum 
the boxes. Similarly, if we are using test items of the relatively si: 
knowledge type, no increase in the number of them on a chapter 
history textbook will give a picture of the pupil’s ability to util 
knowledge in drawing practical conclusions about the affairs of 
through applying the possible lessons which can be learned fror 
history chapter. A test on upper elementary grade reading w! 
based on a knowledge of the authors or characters in various pi 
literature, might contain an infinite number of items and still afi 
reliable information concerning the ability of the pupil to read lit 
with considerable enjoyment—nor concerning his disposition to 
The complexity of a test is determined by the complexity of its ind 
tasks, and their complexity is not increased through the mere a 
of more items. 

If we now turn to another aspect of the question, and consider | 
effect of including in the test items of different degrees of com 
we note that this produces something in the nature of a seale, th: 
of different complexity tending to vary in degree of difficulty. 1 
troduces a problem in knowing how to interpret the score. Pres 
the test will deal with a number of topics, and the instructor will 
items of varying complexity on each topic. The simple sum of t! 
factory responses on these different kinds of test items for each 1 
not quite as understandable as would be the score on a sealed test 
was homogeneous—that is, concerned with only one topie or on 
Drawing again upon the analogy of boxes, the total seore is lik: 
taining the total number of boxes that are satisfactory with re! 
to various aspects, some boxes be ing measured for length, some 1 
of a particular side, and others for volume. Granting that for 
purposes we might be interested in these separate aspects of 
nevertheless the total number of ‘‘satisfactory’’ boxes arrived at 
process of measuring one aspect of one box and another aspect of 
box does not tell us how many are satisfactory with respect to « 


( 
} 
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veral criteria, such as length, area, or volume—and for any rea- 
surpose we should want to know the number of boxes that were 
ry for each separate aspect. Further, it would appear that even 
type of knowledge would not generally be satisfactory for edu- 
purposes. It would appear that the mixture of items on a test 
rying degrees of complexity, if the items are really different 
to cause them to measure different kinds of mental activity, is 
: handicap than a benefit. In the interests of significant measure- 
e items should either be put on separate tests, each having a 
eous level of complexity, or at least the items should be grouped 
ng to complexity and each group scored separately as representing 
t aspects of the ability. Items having a considerable variety of 
ty are of course not necessary in order to achieve any desired 
f complexity in the test, since the maximum complexity of a test 
its most complex items. This complexity is not to be sought 

he simple combination of responses on different items, which 
to reveal the pattern of relationship between the factors which 


e sampled. 


summary, a test which consists of items that are more simple or 


mplex than the response tendencies which are to be measured 

lt in some loss of fidelity in measurement. In the field of physi- 

irement, appropriate complexity is accepted as axiomatic, and 
ements which inelude different numbers of variables, or which 
nt the variables in different combination patterns, are regarded 
rising fundamentally different systems of mensuration. Units of 
ement which have different degrees of complexity simply measure 


nt things. In the measurement of educational attainment we have 


ntiated between different fields of learning but we have not gen- 


7 


ide corresponding distinctions of a psychological sort between 
s of ability called for by test items with different degrees of 
ty. 
ems probable, furthermore, that in many eases we have not well 
complexity of our test items to the complexity of the abilities 
desire to measure. The common run of test items are almost 
nowledge items. If, on the other hand, one studies various ob- 
of instruction, one is prompted to raise a number of questions. 
not to be interested in what a bit of ‘‘knowledge’’ means to a pupil, 
well it will serve his purposes? Are we not concerned with the 
» which the necessary interrelations between this ‘‘knowledge’’ 
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and appropriate forms of expression for its use in practical purpose: 
have been set up? Have we no responsibility for seeing that we 
fitted this ‘‘knowledge’’ into a dynamie scheme of thinking on the 
of the pupil so that he can draw upon it as a basis for evaluation 


for constructive thinking? 


Are we not at all coneerned with the ext 
to which the pupil has develeped the capacity to strip himself of 1 
accustomed classroom correlatives and demonstrate the ability to respo 
properly under the various conditions of normal life with their pee 
distractions and with the various pressures of different purposes? T) 
some of these things carry us outside the range of formal tests; but 
is worth something to recognize this fact so that we will not continu 
rely upon our common tests as adequate measures of everything we nm 
know. 

Perhaps the chief source of difficulty in our current measuring inst! 
ments is that test makers have been content to accept for their guidane 
the relatively superficial concepts of educational objectives which 
widely prevailed in practice. A very mechanical and superficial ty}. 
measurement has naturally followed in the wake of a generally inadeq 
concept of the responsibilities of common education. But test construe 
including teachers who make their own tests, must recognize the 
strong influence which tests have upon instruction, and must eval 
tests at least in part on this basis. Test makers at the present time bh 
considerable responsibility for produeing tests which will aid in giv 
an inereased emphasis to the more fundamental purposes of edueat 
It is the premise of this paper that one step in this direction is the ex 
ination of test items with reference to the appropriateness of their ps 
chological complexity for dealing with the more important edueati: 
outeomes. The time has come for us to recognize that we eannot 
quately measure learning products of great complexity with test 


that are designed to reflect only the most simple kinds of mental acti 


(HE DIFFERENTIAL FUNCTIONS OF EXAMINATIONS 
PALMER O, JOHNSON 
University of Minnesota 

lie construction of examinations is a part of the normal occupation 
most every teacher. With this as with all accepted practices it is 
ssary that the question should be asked from time to time, What is 
purpose of the examination and how well is the purpose accomplished ? 
e purpose is to obtain an appraisal of student accomplishment then 
s highly important to make the measurement as accurate as possible. 
; point of view directs one’s attentions to the aims of instruction. If 
minations are to give measures of the extent to which each of the 
rposes of instruction is attained, then all of these purposes that are 
ible to measurement should be represented in the examination. The 
llment of this need for measures of differential functions is still re- 
with respect to many of the purported outcomes of instruction. Even 
ose outcomes more susceptible at present to measurement the con- 
ction of a valid examination is not a simple matter either in theory 
practice. At least three qualifientions appear fundamental for 


ose who are to construet good measuring instruments: (1) thorough 


wledge of the field, (2) the ability to resolve the subject into parts 


er to testing, and (3) functional knewledge of the principles of test 


nstruction. These attributes are not commonly found in the same 


vidual. With the view of improving present examination practices, 


University of Minnesota Committee on Educational Research has a 


ogram in operation in which the instructors of certain courses, graduate 


stants, and examination counsellors are codperating. It is not the 
rpose here to deseribe this plan in operation. However, since all par 
ints in the examination program are mentioned in the central prob- 
description of some of their activities is essential. These will be 


nted out in eonnection with the diseussion of the main problem which 


neerns itself with: 


1. The measurement of some purported outeomes of instruction. 

”. The interrelations of the abilities measured. 

}. The separable and combined importance of certain variables. 

The instructor is the individual to determine the materials of instrue 
and the methods of presentation and to define the outcomes which 

hopes to attain through their administration. The primary function 
he counsellor is to develop techniques of test construction which will 

923 


; 

INE 
c 
ec I’? 

ma 

extent 

ot ft 

| 

eu 

T) ‘ 

but 
nue 
ne 

nst? 
dane n 

1etors 
aluat 
ih 
rivit 
tio 

. 

vit — 


94 JOURNAL OF EDUCATIONAL RESEARCH [Vol. 80, No. 


reveal the extent to which the outcomes have been attained. In order 
for the counsellor to do effective work it is highly desirable that he hav 
a background in the field in which examinations are to be developed. 

While some work has been done upon measures of outcomes other 
than those reported here, this discussion is restricted to certain aims which 
have been stated in terms of what the student is expected to do with the 
materials of instruction. These aims or outcomes are: 

1. The acquisition of the terminology or vocabulary distinctive to the 


subject. 


~ 


2. The acquisition of fundamental principles and other factual in- 
formation. 

3. The ability to apply the knowledge of vocabulary, principles, and 
other facts in the interpretation of situations and problems. 

In order to secure an authoritative and specifie record of the materials 
of instruction, graduate assistants were used. The assistant was selected 
largely on the basis of the recommendation of the instructor or depart- 
ment with respect to his knowledge of the field in which the examinations 
were to be constructed. He attended the class meetings where he made a 
complete record of the materials presented, studied the basie readings, 
and explored other sources which might be of value in developing test 
situations. These materials were then analysed and classified into tech- 
nical terms, principles, and other factual information. Such were the 
sources for the content of those examinations designated later as exam- 
inations on terminology and examinations on principles and other factual 
information. 

The examination purporting to measure the ability of the student to 
draw upon his knowledge of vocabulary, other factual information, and 
principles requires further description. It is recognized that the tests 
of such outeomes so far developed are empirical tests constructed and 
applied with incomplete knowledge of the abilities measured. The efforts 
in this direction appear justifiable, however, on the basis of the import- 
ance this objective holds among those advaneed as aims of the educational 
process. An objection to an examination that tests only the acquisition 
of voeabulary and other factual information is the illusion on the part 
of the student who feels that if he is able to obtain the answer the teacher 
desires, he has mastered the difficulties of the subject. A knowledge of 
vocabulary and fundamental facts or principles is not the end in itself 
but rather the great trunk from which the spreading branches spring. In 


| 
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ler to motivate the student toward the development of the ability to 
ply knowledge the measurement of the extent of this acquisition should 
so be a part of an examination. 

As bases for determining the validity of those test items designed to 
easure the ability of tle student to draw upon his knowledge of facts 
- principles in the interpretation of problems or situations the following 


means were employed: 


1. Determining whether or not the test situations were new. The 
method of obtaining a record of the materials of instruction, de- 
seribed above, was relied upon in deciding whether or not the test 
situations had been interpreted by instructor or author. This 
analysis also enabled the detection of whether or not the basie 
principle or fact underlying interpretation had been ineluded in 
the course content. Current research and other scientific litera- 
ture provided content for a considerable number of the situations; 
others were improvised.? 

2. Submittal of the test situation both previous and subsequent to 
instruction. If the student can interpret the problem before in- 
struction, obviously this performance cannot be attributed to in- 
struction in the course. This is a desirable criterion of validity 
but could be applied to only some of the test items during the 
first year of the experiment. 

3. Judgment of scholars in the field as to the correct interpretation 
of the test situations. The instructors contributed substantially 
by passing judgment on the correct interpretation of problem 
situations from the standpoint of fact and whether or not the 
ability to interpret called for a knowledge of the principle con- 
sidered basic to the solution. They also contributed a number of 
the test situations. 

Methods (1) and (3) were applied in all eases; method (2) to a sampling 

f the situations. In addition some experimentation was conducted in 

omparing the free responses with the controlled responses of the students. 

An illustration of the items used in the examinations (1) on voeabu- 


iry, (2) on the acquisition of facts or principles, and (3) items calling 


or the interpretation of a problematic situation in the field of physics is: 
*TIt is possible but not highly probable that students encountered some of these 
irces. The large number of test situations, in all cases well over a hundred, would 
nder it extremely unlikely that any significant number would be met with. It is not 
mm on practice for undergraduate students to read current research or widely beyond 
urse assignments. 
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Part I1—Vocabulary 7. mirage 

l. angle of incidence 8. parallax 

2. angle of minimum deviation 9. polarization 

3. angle of refraction LO. real image 

4. critical angle ll. reflection 

5. diffraction 12. virtual image 

6. interference 

l. ( ) Smallest angle between incident and emergent ray o! 
prism. 

2. ( ) Cnange im direction of a ray of light in passing fror 
one medium to another. 

3. ( Change in the direction of propagation of light in 
given medium after encountering the surface of anothe 
medium. 

t. ( ) Image through which light actually passes. 

>. ) Angle between a perpendicular to a surface and the ra 
of light striking the foot of the perpendicular. 

6. ) Angle between a perpendicular to a surface and a ray 
of light after passing through the surface at the foot . 
the perpendicular. 

7. ( ) Angle of incidence at which light may not pass into ai! 


from a denser medium. 


Part II—Knowledge of a Principle 


In 
a. 

b. 
d. 


opties the angle of reflection is: 

equal to the angle of refraction. 

less than the critical angle. 

equal to the angle of ineidenee. 

equal to the angle of minimum deviation in the case of a prisn 
a minimum for light incident on a plane surface. 


Part I1[—Applieation of a Principle 


Highway engineers wish to know the average velocity of cars 


traveling along a certain highway. A mirror is placed so t! 
when a ear crosses a line, its image is reflected to an observer S| 


tioned on the road at a known distance from the line. 


By means 


of a stop watch he measures the time the ear takes to travel fro: 
the first line mentioned to a line across the road directly in fre 
of him. How should the mirror be placed? 


a. 
b. 


The mirror should be perpendicular to the observer. 

The mirror should be perpendicular to the line across the ro 
The mirror should be at an angle for forty-five degrees to ! 
observer. 

The line drawn perpendicular to the mirror should biseet 1 
angle made by a line to the observer and the line across 1 
road. 

The mirror should be placed half way between the observ: 


and the line across the road. 


| 
2) 
| 
| 
| 
d. 
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It is noted that the vocabulary test (1) calls for a knowledge of the 
chnical terms employed in Part Il and Part II]; the test item (2) ealls 


va knowledge of the physical principle that the angle of incidence is 
qual to the angle of reflection; and the test item (3) calls for the 


\pplieation of this principle. 


An illustration drawn from an examination in Human Biology* testing 


fur the knowledge of a principle (2) and its application (3) is: 


(2) Part Il—Knowledge of a Principle 
The principle of bone construction is essentially : 
a. the maintenance of symmetry. 
b. the ability to withstand sudden shocks. 
e. the best distribution of physiological stress. 
d. the largest marrow cavity possible for blood formation. 
e. the maintenance of large lime deposits. 
3) Part I1l—Application of a Principle 
At the World’s Fair, an artificial skeleton was exhibited which 
performed all of the motions of the body, ineluding hitting, 
jumping, and running. The great construction principle of the 
artificial bones was: 
a. to duplicate the external contour of natural bones. 
b. to duplicate the chemical composition of natural bones. 
c. to duplicate the diameter and length of the marrow cavities 
of normal bones. 
d. to duplicate natural lines of stress and strain. 
e. the ability to withstand sudden shocks. 


A third illustration from an examination in Basie Wealth is: 


2) Part Il—Knowledge of Facts 


Of the places mentioned below the one that would be relatively 
warmest on a still evening after a hot summer’s day is 
a. a hay field in a relatively flat region. 
b. the down-town section of a large city. 
*. a suburb of a large city. 
d. a farm on the south slope of a hill. 
e. a typical bituminous coal mine. 


(3) Part I1l—Application 
Observers for the United States Weather Bureau report that 
in summer the late evening temperatures in suburbs are often 
from ten to twenty degrees lower than the temperatures recorded 


*The vocabulary tests for the illustrations in Human Biology and Basic Wealth 


are not presented here. In these instances, a unit of vocabulary consisted of the 
technical terms in several test items of Parts II and ITI. 


A 
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at the same time in the industrial section of the adjacent eit 
The explanation of this is most closely connected with the follow 
ing fact: 
a. Temperature variations are greatly influenced by altitud 
differences. 
b. Suburbs are closer to lakes or other large bodies of water. 
ce. Wind is more common in the suburbs. 
d. There are more trees in the suburbs. 
e. Artificial structures give off heat by radiation for a conside: 
able time after sunset. 
It should be pointed out that the three exammations were separately) 
assembled and that Parts I and II were given in the morning and Part II] 


was given in the afternoon of the same day. In this way, questions 
one examination did not provide suggestions for the answer to questions 
occurring in another. Each of the examination periods was three hours 
in length. 

THE ANALYSIS OF THE MEASURES 


From the description of the examinations and their method of cor 
struction attention is now turned to the analysis of the test results 
Although similar data are available for courses in Astronomy and Tee 
nology, the findings presented here will be limited to those resulting fror 
the examinations in three courses: Physies and Chemistry, Huma: 
Biology, and Basie Wealth. The coefficients of reliability of the who! 
examinations in these fields were: Physics and Chemistry, r = .96 + .006 
Human Biology, r = .95 + .006; and in Basie Wealth, r = .98 + .00 

See Table 1). 


INTERRELATIONS OF MEASURES 


The nature of the examination program made possible some explora 
tion into the problem of the interrelations of the measures on the sever 
parts of the examinations. Since we are interested in the intrinsic re la 
tion or association of the abilities measured, the raw coefficients of t! 
correlation have been corrected for attenuation 

The examinations in both Physies and Chemistry and Basie Wealt 
consisted of three parts. Part I was made up of vocabulary iten 
Part II of items dealing with principles and other factual informatio 
and Part III, of items ealling for interpretation and application 
principles. The coefficients of correlation between the measures of t 
acquisition of vocabulary and of principles and other factual informati 
82 + .03 (atten. r= .85 + .02) in Physies and Chemistry, an 


were; 
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TABLE I 
RELIABILITY COEFFICIENTS OF THE EXAMINATIONS 
( Sp. Br. ru 
tamination of Chemistry Basic Human 
, and Physics Wealth Biology 
ual 
Terminology .96 + .006 .96 + .007 


96 + .006 
Il Principles and other Factual Information .91+.015 .94+ .01 

III Interpretation... .83+ .03 .64+ .04 
Examination .98+ .003 .95 + .006 
II View points on Health and Disease. ..... .03 


mber of Cases. . oe 77 54 74 


TABLE II 
RCORRELATIONS OF THE SEVERAL PARTS OF THE COMPREHENSIVE EXAMINATION 


MS Pert II Part ITI 
' Principles and Other Interpretation No. 
ans nination of Factual Information ind Application of Cases 
r P.E. Atten.r P.F. r P.E. Atten.r P.E. 
Terminology 
Cc} etry and Physics .82 + .03 .85 + .02 75 + .08 82 + .03 9 
1 “ th 70 O4 74 + .04 67 + .05 77 04 54 
Hur g 
ts IT Prir es and other 
I n 
( 77 + .03 87 02 78 
} 78 o4 02 54 
n B 60 O05 77 03 73 
Health and Disease 
Human Biology .29 + .07 34 + .06 41 + 06 .58 + .05 72 


04 (atten. r= .74 + .04) in Basie Wealth. Other intercorrelations 
between vocabulary and interpretation or application .75 + .03 
n. r = .82 + .03) in Physies and Chemistry; .67 + .05 (atten. r = 


04) in Basie Wealth; between the measures of the acquisition of 
neiples and the measures of interpretation and application: .77 + .03 
tten. r = .£87 + .02) in Physies and Chemistry; .78 + .04 (atten. r 
“9 + .02) in Basie Wealth (Table IT). 
The organization of the examination in Human Biology differed some- 
it from that of the examinations for the two courses described above 
Part I eonsisted of test items dealing with principles and other factual 
rmation including voeabulary. Part II was made up of items dealing 
th various aspects of health and disease; Part III was comprised of 
ms calling for interpretation and application of principles. The co- 
ients of correlation between the several parts were: Principles and 
ier factual information, and interpretation and application, .60 + .05 


ely 
Il] 
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(atten. r = .77 = .03); health and disease situations, and principles and 

other factual information, .29 + .07 (atten. r = .34 = .06); health and 
disease situations, and interpretation and application, 41 + .06 (atten. 

r 08 + .05 


The magnitude of most of the coefficients of correlation between the 
various measures point to the inference that the ability to acquire in- 
formation on the part of students in these courses has been accompanied 


to a substantial extent by the ability to apply this information. 


THE SEPARABLE AND COMBINED IMPORTANCE OF CERTAIN VARIABLES 


A further method of analysis makes possible the measure of the com- 
bined importance of the several independent variables in estimating the 


dependent variable. If we consider (1) the measure of the ability to 
interpret and apply principles and other factual information as the de- 
pendent variable, and (2) the measure of voeabulary, (3) the measure 
of the acquisition of principles and other factual information, and (4) the 
scores on the Minnesota College Aptitude Test, as dependent variables. 
the multiple correlations are: 


For Physies and Chemistry 


R, 224 — -803 Atten. R, .,, = .87 
For Basie Wealth 

R, .., — .831 Atten. R, .., 4 
For Human Biology 

R, «4 — -749 Atten. R = .91 


The number of cases entering into these computations were those stu- 
dents for whom all measures were available: 74 in Physies and Chemistry, 
48 in Human Biology, and 72 in Tluman Biology. 

When the multiple correlations are squared, an index is obtained of 
the proportion of the variance in the dependent variable which is mathe- 
matically accounted for. In the instance of the above multiple correla 
tions this proportion becomes 76 percent in Physics and Chemistry, 
88 percent in Basie Wealth, and 83 pereent in Human Biology. 

A measure of the separable importance of each of the independent 
variables is obtainable by means of the multiple regression equation where 
the standard deviation of both the independent variables and the de- 
pendent variables is taken as unity. These equations for our problems 


are: 


| 

= 
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Physics and Chemistry 

X, = .3730 x, + .6211 x, + .1755 x, + K 
Basic Wealth 

XxX, = 
Human Biology- 

X, = x, + 4700 x, + K 


2172 x, + .6433 x, + .2553 x, + K 


The percentage of influence (or association) of each of the indepen 
dent variables upon (or with) the variance of the dependent variable is 
viven by the squares of the regression coefficients. The values and the 


wreentages or weight for our problems are: 


Variable Regression Percentage 


Physics and Chemistry Coefficient Squared or Weight 
4. College Aptitude .. . 0308 5.5 


Variabl Ri qre sston Pe reentad 


Basie Wealth Cor fhiv ni Square d or We right 
0471 8.9 
4. College Aptitude 0652 12.4 


Variable Re qre ssion Py ree ntage 


Human Biology Cocfiicient Squared — or Weight 
2. Vocabulary 
and 5008 69.4 
3. Principles, ete.| 
4. College Aptitude... ............ .2209 30.6 


So far as the factors considered contribute toward the ability to apply 
nowledge, knowledge of voeabulary, knowledge of principles and other 


factual information, and the ability measured by the college aptitude test 


contribute with the relative weight of 4.5: 12.6: 1 in Physies and Chem- 
istry and of 1: 8.8:1.4in Basic Wealth. Knowledge of principles, vocabu- 
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lary, and other factual information (combined) and the ability measur 
by the college aptitude test contribute with the relative weight of 2.3: 1 i 
Human Biology. 

The. squares of the regression coefficients give the measures of tl 
single importance of the independent variables. Since these variables 
are correlated some measure of their joint contributions is desirable. A: 
estimate of this joint contribution is attainable through the application ot! 
the method of path coefficients developed by Sewell Wright. Through the 
application of this technique, the net joint contribution of a knowledg: 
of vocabulary, a knowledge of principles and other factual information, 
and college aptitude as measured by the college aptitude test was found 
to be: .2309 in Physies and Chemistry and .3141 in Basic Wealth. 

It may be well to point out again to the reader that this analysis has 
been limited to a consideration of three of the measurable outcomes o! 
instruction. Obviously there are other outcomes which have not bee: 
considered and for which highly reliable and valid measures are not yet 
available, 7. e., the de velopment of interest in science. the ability to ust 
the scientifie method, the de velopment of scientific attitudes, the ability 
to manipulate laboratory apparatus, or laboratory resourcefulness, iy 
creased powers of observation, ete. The outcomes to be given most im 
portance in examinations will depend upon those held of highest purpos: 
in instruction. For instance, in this study if the ability to apply a know! 
edge of vocabulary, principles, or other factual information to the solu 
tion of problems or situations be considered the end-product or the sol 
purpose of instruction, then it might be argued that it alone needs to bi 
tested for. However, if a measure of growth in scientifie vocabulary o1 
the acquisition of important principles is wanted, separate measures 
would be neces ssary for their determination. Even if it be accepted that 
functional knowledge is the end-product, it will likely be of considerabl: 
value for diagnostie and instructional purposes to know the competence: 
of the student with respect to other abilities and the relation they bear t 
one another and to the end-product itself. Likewise in the determinatior 
of the relative weightings by means of the multiple regression equation: 
such additional factors as initial status of students, maturity, readir 
abilities, sex, and others might have been considered, so that it should bi 
kept in mind here as well that the weightings are with reference to th: 
independent variables introduced. 


* Wright, Sewell. ‘‘Correlation and Causation,’’ Journal of Agricultural Re 
search, XX (1921), pp. 238-255. 
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SUMMARY 
ured 
1} We may now sum up the main points of this discussion of the measure- 
t of differential functions. 

t} Valid examinations should aim to measure all the purported out- 
bh s of instruction that are amenable to measurement. 

A} 2. The outcomes of instruction should be defined in specifie terms 
ne at the student is expected to do to reveal the extent of his acquisition. 
the 3. The process of developing examinations directed at the measure- 
deg t of three outeomes of instruction has been described. 
ion !. While the interrelations of the abilities tested were high in some 
und s and substantial in others, separate measures appear essential in 

er to make a more accurate appraisal of student accomplishment. 

ine 5. The weighting in order of the separable importance in determin- 
7 ability to apply knowledge is (1) knowledge of informational facts 
- principles, (2) vocabulary, and (3) the measure of college aptitude 
ust 
it 
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RELATION BETWEEN INTELLIGENCE AND CERTAIN 
ASPECTS OF PHYSICAL ABILITY 
J.C. AND OrTo PosTPICHAI 
Temple University 
Tuts study considers the relationship between intelligence and certain 
phases of physical achievement. It was undertaken because of the feel 
ing apparently prevalent among many Philadelphia teachers of physica! 
edueation that they found lower levels of achievement in physical activities 
in the schools organized primarily to eare for children of lower mentality. 
Previous studies seemed inadequate in one or more or several partieu- 
lars. In some instances the definition of the population of the studies 
was not precise; in others, the measure of physical ability was derived 
from scores achieved in several events, necessitating the establishment of 
an index number, derived by weighting the several events. No such index 
numbers were presented. Another defect was that averages and means 


without measures of dispersion were presented." 


THE GENERAL METHOD OF THE STUDY 

The subjects of the study were 656 boys in two special schools in the 
city of Philadelphia. Only boys were considered in order to eliminate 
sex as a variable. Beeause of the obvious effect of serious degrees of over 
weight or under weight conditions, all individuals thirteen percent under 
weight or over weight, according to the Baldwin-Wood Tables, were ex- 
cluded A mental score for each boy under consideration was obtained 
from the offices of Philadelphia schools. Each boy was given athletic tests 
hy the physieal education teacher in the following events: standing 
broad jump; overhead ball throw; 50-vard dash; standing hop, step, and 
jump; chinning. The better result of two trials was reeorded as the 
result or score except in the dash and in chinning, in which only one 
trial was given. These tests were repeated twice, after intervals of one 
month 

The reliability of these athletic tests was checked by computing corre 
lations with two sets of seores for each of the events. The coefficients 


ranged from .82 to .92, indieating a high degree of reliability.* 


Paterson, Donald G Physique and Intellect. New York: Century Co., 1930 
especially page 169 and pages 284-86. 

*Kellev, Truman Lee. Interpretation of Educational Measurements. New York: 
World Book Co.. 1927 According to Kelley, the minimal satisfactory reliability, as 
determined by a reliability coefficient, of a test for measuring a school group in some 
specific subjeet and esti ating future group promise in the same or 2 closely related 
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6] INTELLIGENCE AND PHYSICAL ABILITY 105 
rder that the influence of age might be reduced to a minimum the 
s were grouped chronologically at step intervals of one year. For 
e all of the boys over 13 years 11 months of age and not over 
s 11 months of age were grouped together. The relationship be- 
ntelligence, as indicated by I.Q.’s, and athletic ability, as measured 
| of the five events, was caleulated separately for each age group. 
se caleulations were computed on the basis both of average results 
n each event, and of best results achieved during the three months. 
interest to note that the distributions obtained by the two methods 
{ differ materially. 
e ealeulations ineluded correlations between I.Q.’s and seores in 
vent on each age level and determination of the forecasting efficiency 
ted by each coefficient of correlation. All correlations were com- 
by the Pearson product-moment method, and in each ease Blake 
test® indieated the relationship was linear. 
PRESENTATION OF DATA 
Table | the mean and standard deviation of the L.Q.’s of each age 
ire given; in Table II, the means and standard deviations of 


of the events. 
rticular attention should be given to the sigma deviations in each 


jpon means or averages. It may be noted for instance in Table I] 


e mean of any age group does not differ by more than one sigma 


the mean of the preceding or succeeding group. The means and 


rd deviations exhibited in Table T show no significant difference in 


nental ability of the age groups. 


TABLE I 
STANDARD DEVIATIONS OF THE DISTRIBUTIONS OF L.Q.’s OF 656 Boys 


IN THE INDICATED AGE GROUPS 


ip Number of Cases Meat Sigma 
16 
l 7 9.4 
i 13 73.4 ’ 
9 73.6 9.10 
oo 7 9.30 
BR, 
rrett, Henry I Statistics in Psychology and Education. New York: Long 
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TABLE II 
MEANS AND STANDARD DEVIATIONS OF RECORDS OF THE EVENTS FOR THE 
INDICATED AGE GROUPS 


EVENTS Age 11 12 13 i4 15 lf 
Jus Inches 
| Ave Mean 62.7 66.6 70.3 73.9 78.4 80 
Score S . 6.7 6.2 7.5 7.8 8.5 7 
I M 65.6 69.0 71.8 76.2 80.4 s 
6.4 6.5 7.5 8.2 8.8 Ss 
The Feet 
4 Mear 4.1 26.0 28.9 31.5 34.5 
| 8 7 14 1.9 5.3 18 
Be 25.5 27.4 30.5 33.0 35.2 38 
Seore S 3.9 5.3 
D Seconds 
Ave Mean 8.16 7.98 7.71 7.48 7.33 6 
Sigma 19 2 55 
i fen 8.00 7.78 7.57 7 7.03 6.8 
core Sigma 16 4 58 
Ave M 14.2 15.3 15.6 17.1 18.2 18 
> 1.9 20 2.5 2.6 2.4 
. Best } 15.2 16.1 16.5 17.9 19.3 19 
Score Sigma 1.9 9] 2.1 2.4 2.5 ? 
Chi Times 
Ave Me 4.2 4.8 5.1 7.0 8 
Score § ’ 2.0 2.9 2.8 3.2 3.4 2 
Rest M 5.2 5.6 5.8 6.5 7.9 8 7 
res na 2.5 3.2 3.4 2.8 
| Tables III* and IV, displaying the performance standards set respec- 
tively for general and for special classes in Philadelphia schools, are pro 
vided for purposes of comparison. It will be noted that the averag 
| achievement indicated in Table IT in each instance exceeds that expected 
of special classes, and closely approximates that demanded for a grad 
TABLE III 
PHILADELPHIA AGE AIMS IN PHYSICAL EDUCATION FoR NORMAL CLASSES 
Standing Dodeehall 
Age Broad Jump ~* < Far Throw] 50 Yard Dash™ Chinning | 
“eet Inches Feet Seconds Fifths Times 


Years F G E F G E F G E F GE 


16 5-10 0-7-1 7-10 31 39 45 7-4 6-4 6-2 
15 5-8 6-9 7-6 28 36 42 SO 7-0 6-3 2 6 8 pe 
14 5-5 6-5 7-2 25 33 39 8-1 7-1 6-4 om. 2 
13 5-" 6-1 6-10 23 30 35 82 7-3 7-0 5 6 
12 5-10 6-6 83 7-4 7-1 
11 7 5-7 62 20 2 30 &4 89 7-2 3.5 
10 1 5-3 10 19 24 28 9-0 8-1 7-3 3 5 
9 4-2 0 5-7 17 22 2% 91 8&2 7-4 2 4 
3.10 1-9 { 16 9-2 8-3 1 3 


‘The basis for the erades is said to be that experience and observation indicat 


the upper 10 percent should reach E standards, the next 40 percent G standard, tl 


next 40 percent F, the remaining 10 percent reeciving a grade of unsatisfactory. 


Vo 
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+ in general classes. Grade F achievement is exceeded consistently 
he scores of Table II. 


lf 
TABLE IV 
80.4 LADELPHIA AGE AIMS (Boys) IN PHYSICAL EDUCATION FOR SPECIAL CLASSES 
a2 = Standing Ball Throw 50 Hop-Step 
g Broad Jump Overhead Yard Dash Chinning Jump 
Feet Inches Feet Seconds Fifths limes Feet 
5-8 28 8-0 3 15 
5-6 28 8-2 2 14 
aN 2 24 8-3 2 13 
23 2 12 
1-£ 21 9-1 2 2 
1-4 20 9-3 l ll 
6.8 4-3 18 9-4 1 11 
1-0 16 l 
3-10 13 10-1 7 
18.7 
2.4 
19 in Table V correlations of scores and I.Q.’s within each age group 
displayed for each event, as well as the coefficient of alienation and 
8.) ts complementary index for forecasting, which indicates that in no case 
87 : the predictive value high. There is no justification with correlations of 
der obtained for assuming that the measures are sufficiently related 
" permit the establishment of standards within groups of comparable 
ro chronologieal age. It is sienificant, however, to note that the highest 
1% orrelations were secured between I.Q. and the hop-step-jump event; the 
ted west between I.Q. and chinning. It seems that the more complicated 
mi events, t.e., ‘‘eomplieated’’ in terms of muscle groups involved and co- 


lination demanded, are correlated more highly with intelligence as 


fined by these I.Q.’s than are less complicated events. 


\n extension of the study was conducted with the data from the 70-74 


eroup, selected beeause its population (135 eases) was the greatest 
nd in any five point I.Q. step interval. For this group the correlation 
een chronological age and seores in the five events, with the eorre- 
sponding values of K, the coefficient of alienation, and the consequent 
ecasting index were computed. The results are displayed in Table VI. 
Table VIT in which these results are compared with those based upon 
[.Q. seore correlations, it will be noted that the predictive value of age is 


greater. 
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COEFFICIENTS 


EVENTS 

Average Jump 
Coeff. of Correlation 
Probable Error 
Coeff f Ahenation 
Fore¢ isting Index 


Coeff. of Correlation 
Probable Error 
Coeff. or Alienation 


Fi recasting Index 


Average Thr 


Coeff f Correlation 
Probable Error 
Coeff. of Alier n 


Coeff \ lation 
Forecasting Index 
h 
f Correlation 
Error 
f Alienation 
ng Index 


re ting Index 
Ave Hor-Step-J ur 
Coeff f Correlatior 


Coeff. of A 


enation 
‘orecasting Index 


Rest Chinning 


Coeff. of C 
Probable Er 

Coeff. of Alienation 
Forecasting Index 


rrelation 


ELATION 


RELATIONSHIP BETWE! 


FOR 
\ge 


AND 


THE 


TABLE V 


ALL 


N 1.Q.’s 


\ 


VA 


ION W 


XD 


SCO 


ITI 
tk 


S 


FORECASTING 


ATHLI 


INDICATED AGE GROUPS 


[ Vol. 30 


INDICES FOR 


EVENTS 


12 13 14 1S 
.35 .44 46 44 
05 .05 O5 O05 
O4 su 87 su a0 
6 13 10 
Best 
30 17 .47 .40 
07 05 05 05 
95 SS . 87 SS .92 S 
5 12 13 12 8 
07 06 05 05 05 
ay 40 a3 KA 
Fore sting index > 7 9 10 7 | 
Best Thr 
Coeff. of Correlation 12 3 12 
Prot | 07 O68 05 05 
6 6 10 
Are 
10 38 7 j 
O7 06 O5 O5 O5 7 
95 O5 93 93 
5 5 7 7 6 f 
Best Dash 
Coeff. of Correlation 33 32 34 
Probable Error O7 O68 OS Os 05 Oy 
( \ n o4 as a3 
6 5 6 7 6 t 
I ble I 06 O5 O5 05 04 ( five 
Coeff, of Alienation S7 S7 
Forecasting Index 11 13 13 1! 15 lf lel) 
Best H Step-Jump vp) 
Coeff. of Correlation 50 15 52 
Probable Error O05 O5 O5 0 | 
Coeff. of Alienation S7 a7 
Forecasting Index 11 12 13 11 15 Lf Phe 
Arerage Chinntr 
Coeff. of Correlation 19 15 20 2 20 d 
Probat Error 06 05 O68 
I 2 2 2 
F 
| 23 14 21 25 15 
07 06 O5 O68 
97 99 07 
3 I 2 3 1 
‘ 
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TABLE VI 


CIENTS OF CORRELATION BETWEEN CHRONOLOGICAL AGE AND EVENT SCORES 


FOR TH! AMONG 155 CHILDREN OF I.Q. 70-74 

Coeff. of Probable Coeff. of Forecasting 

I Correlation Error Alienation Index 

.71 .03 .70 30% 

[ .70 .03 71 29% 

.73 03 .68 32% 

Jump 64 03 me 23% 


TABLE VII 
COMPARISON OF FORECASTING INDICES DERIVED FROM THE RELATIONSHIP BETWEEN 
I.Q.’s AND CHRONOLOGICAL AGE WITH EVENT ScORES MADE BY 
35 CHILDREN OF I1.Q. 70—74 


Percent of Percent of 

Forecasting Forecasting 
. EVENT Efficiency Efficiency of 
ut of I. Q Chronological Age 

Jump 11 30 

Throw 8 
7 Dash 6 32 

Hop-Step-Jump 13 23 

Chinning 2 6 
SUMMARY AND CONCLUSIONS 
, The study is one of correlation between I.Q.’s and scores in each of 
0 live athletie events achieved by 656 boys in the publie schools of Phila- 
' lelphia. The correlations between I.Q.’s and scores in the athletic events 


; vere positive but too low to be of much forecasting usefulness. The 
~ LQ. seore correlations were higher for the more complicated events 
‘hese faets indieate a definite correlation between the presumably de- 
sirable attributes of intelligence as measured in the study and the athletic 
ty tested in the five events. Brighter boys tend to achieve better 
scores. However, the individual variation is so great, and the forecasting 
is so small that these tendencies should not be given an individual 
lication. 
Nore: Readers interested in the exact statistical procedure, including demon 


n of the linearity of the correlation, significance of the coefficients, and similar 


mitted in the interest of space are referred to: Postpichal, Otto. The Rela- 


een Intelligence and Athletic Ability in Cases of Orthogenic Backward Boys. 
ritten Master’s Thesis, Temple University, Philadelphia. ) 


IMPROVEMENT IN EDUCATIONAL ACHIEVEMENT ACCO\V 
PANYING A HEALTH EDUCATION PROGRAM* 
MARTHA CRUMPTON HARDY 
Elizabeth McCormick Memorial Fund 


AFTER two years’ participation in a general health education progran 
condueted in Grades I and II, pupils in Grade HII (both high and low 
sections) were selected for an experimental investigation on the measw 
able effects of health teaching projects. Pupils from twelve schools of th: 
publie school system of a small industrial city were included in the ex 
perimental study. In eight of these schools an extensive three-year healt 
education program was carried on, which consisted of special elassroon 
instruction on the principles of healthful living, conferences with parents 
and teachers by a staff of child specialists, individual pupil interviews 
periodic physical examinations by a pediatrician in the presence of | 
parent, and follow-up work by the school nurses. Children in thes 
schools are herein referred to as the health instructed or experiment 
group. In the remaining four schools the pupils were given year); 
physical examinations but had no special health teaching other than t 
pre scribed course in hy giene, These pupils formed a control group agains’ 
which the improvement of the experimental group could be compare: 

Pupils were selected for the study primarily on the willingness of t 
parents to codperate in a long time program. At the conclusion of t 
investigation the reeords showed 409 of the 452 originally selected pu; 
with complete physical, psychological, and edueational data. Of thes 
268 had remained in the health instructed classes, 104 had contin 
throughout in the non-instrueted classes, and 37 had transferred fro 
one group to the other. 

Educational achievement was measured by the Stanford Achieveny 
Tests which were administered annually in May. Over 800 pupils t 
the test for three consecutive years. At the time of the first education 
test 69 percent of the selected cases were in Grade III and 31 pereen' 
had advaneed to Grade IV-B. At the third test 68 percent wer 
Grade V, 27 percent had advanced to Grade VI, and 5 percent w 
in Grade IV. 

The school situation for the groups under observation was as unifor 
as possible and from the educators’ point of view there was no reaso 

*These data are from an investigation conducted in the publie schools of J 


Illinois. The general report of the study will appear in the fall of 1936 unde: 
title Healthy Growth, published by the University of Chicago Press. 
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ect any variation in school accomplishment. Detailed yearly reports 
test results from each class examined were made to the superin- 

t of the elementary schools. It would, therefore, seem quite un- 
that the teachers in the control schools were any less interested in 
good test records for their pupils than were the teachers of the 
mental group. Any special subject testing, other than that of the 
tigation, was planned by the school supervisors and affected all 
ols equally. Some teachers of the elasses given health instruction 
e greatly interested in the program and, unquestionably, gave a strong 
ntive to their pupils. But the teachers in the control appeared to be 


Vi 


much interested in their work as the other teachers, and did as good 
etter general teaching, which after all is a very significant factor in 
| achievement. 

Reports and recommendations relative to pupil abilities and disabili- 
were made by the psychologist to the principals and supervisors of 
e pupils examined by her, ineluding discards from the major study 

s well as the eases forming the control and experimental groups. The 
trol thus had the benefit of these special suggestions, although they 

rised the only efforts made to include aspects of mental hygiene in 

e health teaching program. In fairness to the children and as a means 
nsuring continual coéperation of the teaching staff of the control 
ils, this concession was deemed expedient. It was, of course, a psy- 
logical service which should follow any efficient testing program and 
s been treated as such, but it gives further evidence of the uniformity 

e school situations of the groups under observation. 

‘rom the test results it appeared likely that the selected cases were 
riter and more successful in school than the pupils who were not 
ided in the study. They, were also somewhat younger. Table I pre- 


TABLE I 
STATUS OF THE SELECTED AND DISCARDED CASES AT THE INITIATION 


A\TIONAT 
OF THE HEALTH PROGRAM 
Intelligence Educational Reading Arithmetic Spelling 
Age Quotient Grade Quotient Quotient Quotient Quotient 
N M M Av. M M M M 
ructed 268 9-2 105 3A 109 108 108 111 
ere 37 o-4 99 3A 106 104 104 108 
104 9-5 96 3A 105 103 106 109 
416 9-9 97° 3A 100 97 101 102 


f these cases had the Stanford Revision Intelligence Test which was given annually to the selected cases 
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sents the general educational status of 825 pupils in the twelve elementar 
schools at the time of the initial tests. On the average, the pupils to whom 
special health instruction was given had the highest scores. 

Since the groups were not equally suecessful when the projects wer 
begun, it was necessary to make them so before the influence of the healt 
work on school improvement could be determined. For comparativ 
purposes, the two main groups under observation were equated with re- 
spect to initial test seore and age. The procedure followed was that of 
making the distributions proportionate, which resulted in eliminating t! 
low scoring and older pupils from the control group and the high seoring 
and younger pupils from the experimental group. The elimination was 
done by drawing the required number from each age, sex, and score « 
tribution, the ratio between the groups being kept constant. The names 
were written on slips, which were placed in boxes classified according t 
pupil sex, age level (12 month interval) and initial test score (10 point 
interval) and the drawing done by pure chance. The results are 
sented in terms of the total educational score and of the scores for t 
special subjects of reading, arithmetic, and spelling expressed as ages 
or inerements of improvement. The reported data are limited to thes 
three subjects because the content of the primary examination of 
test is comparable to the advanced form in only these subjects. 


RATE OF EDUCATIONAL DEVELOPMENT DURING THE HEALTH PROGRAM 

Development curves have been plotted from the educational age d 
and are shown in Figure 1. The superiority of the health instruct 
group to a control of like ages and initial accomplishment is striking! 

~ revealed in these eurves. It can be stated with a high degree of « 
fidence that the pupils who participated in the health projects shoy 
greater improvement in their school subjects during this period tha 
control group. The critical ratio of the difference corrected for eco: 
lation of retests was 3.3 in standard error units. 

For most of the eases, the interval between tests was an exact calen: 
vear, but, of course, there were some irregularities. In order to elimir 
the possibility that group inequalities were due to variations in the test 
procedure, an average monthly increment of achievement was determi 
for each pupil. This was done by dividing the total gain, in terms 
educational age, by the length of time intervening between the dat 
testing. For illustration, if a pupil’s score on the first test was 110 « 


eational months and that on the last, 138 months, his gain would be 2 


, 
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ntar 
BOYS GIRLS 
Whon \ 
14g 
We 
1ealt 
rative 
th re- | 136 | 
lat of 
Tu | 1% 
Oring 
was 124 | 124 
| 
lames 118 118 
12 1 ) 94 7 ) (12 mos.) (24 mos.) 
pol 
— Instructed N= 85 — iH Instructed N= 87 
rt (‘ontrol Gronr N 4 ---= Control N 34 
g 1: DEVELOPMENTAL CURVES MEASURED IN COMPOSITE EDUCATIONAL AGE, SHOW- 
SCHOOL IMPROVEMENT DURING A H&ALTH PROGRAM WHEN THE GROUPS 
- WERE EQUALLY SUCCESSFUL ON THE First TEST AND OF LIKE AGES 
I 


lis and, if the time interval was 25 months, then his average growth 
ement would be = or 1.12 edueational months to eaeh ealendar 
MI mtn, 
lat ~ An inspection of the results expressed in terms of this monthly incre 
of growth showed conclusively that the health instructed group 
the higher rate of accomplishment during the years covered by this 
estigation, the critical ratio of the group difference being greater 
3.00. With respect to particular school subjects, the differences 
less marked than those for general achievement but their trend was 
uniform. 
From the age comparisons, it was apparent that, age for age, the 
mplishment rates were higher for the health trained group. Out of 
two age and sex comparisons, the rate of the health trained was 
ded or equaled by that of the control group in only seven instances, 
f these occurring with the eleven year old group, which had a very 
number of eases, and the other two with respect to the arithmetic 
s of the nine year olds. 
ese results on school accomplishment were from groups made com- 


rg le with respect to age, sex, and initial educational score. Ratings 
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on the intelligence tests indicated that they were also equally bright. 
careful inspection of the yearly I1.Q.’s, however, established a difference 
between the groups, the health trained having the higher seores (critics 
ratio, 3.02 standard error units). Consequently, the instructed grou; 
which was composed of the more capable pupils should have made mor 
rapid progress. 

This difficulty was met by equating the groups with respect to the fou 
variables of age, sex, I.Q., and initial achievement. While the size : 
the groups was reduced by this procedure, the distributions remaine 
proportionally the same, the experimental group containing 2.5 times as 
many pupils as the control. In every case, the size of the control wa: 
greater than 50. 

The ability classifications were based first, on the initial I.Q. and t 
initial achievement score, when this was judged in terms of the composit: 
educational age. These findings were then checked by using the averag 
of three I.Q.’s, as a more satisfactory estimate of general intelligenc 
and the initial scores in the school subjects, as the basis for comparing 
progress during the investigation. The similarities between the groups 
under these conditions were without question, e. g., the average child 
each group had a rating on the first tests of 100 as his I. Q. and 9 years 
10 months, as his educational maturity. There were differences, however 
with regard to the achievement in the various subjects. When the initi 
accomplishment in these was taken into consideration in the equating 
procedures, the variations in no case were as large as two months a’ 
wherever they occurred, the advantage was uniformly given to the cor 
trol group. 

‘ In the findings from these comparisons, the average gain of th 
health instructed group, without exception, was larger in each of th 
school subjects than that of their control, when the factors of abilit 
and initial achievement were both held constant. It would seem ver 
probable that a true difference was indicated in regard to general achiev 
ment, since the er'tieal ratio was as large as 2.36, when the rate of in 
provement was uncorrected for correlation of retests. Certainly the p: 
abilities would be higher than 99 to 1 for the more rapid progress of 1 
instructed pupils. Complete reliability was established in so far as differ 
ences in spelling proficiency were concerned. (See Table IT.) 

A certain amount of overlapping in the school achievement of differ 
ent grades is commonly expected. Consequently, when two groups 
alike with respect to age and achievement, it is not always the ease | 
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they are in the same grades. If, in equating the groups, a larger pr 
portion of the instructed than of the control had been seleeted fron 
the highest grade level, then extra drill and greater familiarity with +! 


subject matter might have accounted for their more rapid progress during 


the period of this study. That this was not the situation, was found whe 
the age-grade records were examined. 

Age for age, the control group were more frequently from the advance 
grade and, where age variations occurred, the control were the younge: 
While the differences were not large, fewer among the control wer 
the lowest grade (3B) and more were in the highest grade (4B) at t! 
time of the first test, than among the instructed group, although the ty 
groups were, on the average, of the same age, intelligence, and achiev 
ment. Inspection of the age-grade distributions also showed that a great: 
proportion of the youngest pupils from the control than from the in 
structed were doing advanced work. 

The comparative results have clearly indicated that, when a grow 
given health training were of the same age and intelligence as a contr 
group, although somewhat less advanced in school and having a lowe: 
achievement record, the health instrueted pupils tended to show great: 
improvement in their regular school work. It is quite possible that th 
few exceptions to this general trend were outcomes of the minor hand 
caps placed upon the experimental group, which a short-time progra! 


could not always overcome. 


IMPROVEMENT UNDER CONDITIONS OF THE INVESTIGATION 
COMPARED WITH SCHOOL STANDARDS 

As the school tests were given to all pupils in the classes selected f 
study, irrespective of their connection with the experiment, it was possi)! 
to develop local norms evaluated for the practice factor involved in ¢! 
re-examinations. Hence the improvement of the pupils under obser\ 
tion ean be contrasted with the expected achievement of pupils at thei 
grade level and with the actual achievement of their classmates. 

According to the grade standards for the New Stanford Achievemen' 
norms, a pupil progressing from 3A through 5A should have gained 2! 
to 25 months in edueational age. When the test scores on the ear!) 
forms of the test were translated into the new values, it was found tia! 
both the health instructed group and the control group tended to ex 
eeed the standards. At the beginning of the investigation, the averag 
pupil among the cases under observation was in the advanced section 0! 
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[1] and had an edueational age of 9 years 11 months, which is 
four months in advance of the norm. In two years when the 
were completing Grade V their educational age was 12 years 
ths, as contrasted with the expected standard of 11 years 8 months. 
low much of this gain in test seores was the result of the previous 
ence with the test situation and how much was due to school im- 
ment during the health program cannot be definitely determined 
these data. However, it can be stated with certainty that the test? 
; of the health instructed pupils exceeded the usual standard for 
ls from similar age and general intelligence levels, since the chances 
less than 1 in 10,000 that their gain was as small as 25 months. The 
st gains of the two groups in edueational achievement were as follows, 
x the New Stanford Achievement norms: 


TABLE 


BOYS GIRLS BOYS & GIRLS 
Mean Mean Mean 
(,ain S.E. (sain S.E. (Crain S.E.* 
icted 3.5 1.8 2.4 6 3 1.24 
26.5 17 26.1 2.61 “6 2.07 
I mi ne z 


The standard errors have not been corrected for correlation 


(‘omparisons of the achievement of the selected eases with the gains 
sed on retest results from pupils in the same classes as the control group 
} took no part in the general program clearly showed that the health 
tructed pupils had made greater improvement than a non-instructed 
up who had had similar experience in amount of practice with the 


est materials. There were 171 pupils in the control schools who had no 


rect contact with any aspect of the health education program during 
e period of this research. These discards included children whose par- 


nts were uneertain as to their remaining in the community for the next 


vears; whose parents were uninterested in codperating in a school 
lth program; whose parents because of religious attitudes did not 
sh their children ineluded in the health work; or whose parents under- 
od too little English to participate in the plan. This non-participating 
up was not, then, an unselected one but their records provide a fairly 
irate check on expected improvement under a yearly testing program. 
It was not practical to translate ail records from the pupil population 
the values for the New Stanford Achievement norms. Hence, the 
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comparative findings in terms of the local standards are presented j; 
terms of the 1926 norms. Table IV shows the amount of gain during 
24 months in general educational achievement and in the special sub ject. 
of reading, arithmetic, and spelling. Without exception, the gains mad 
by the pupils participating in the health projects were greater than thos 
made by either the control group or the diseards. On the whole, it seems 
highly probable that a true difference between the test scores of th 
health instructed group and of the discards at the same grade level was gi 
established, the critical ratio in standard error units being 3.00. In gey ol 
eral, the rate of improvement of the control group appeared to be thy 
same as that of their classmates who were not included in the investigat ivi 


TABLE IV 
IMPROVEMENT AS SHOWN BY SCHOOL TESTS OF THE SELECTED CASES CONTRASTED WI 


THAT oF TurtmR CLASSMATES WHO Hap No CONTACTS WITH THE n | 
HEALTH PROGRAM (1926 Norms) iv 
LOCAL NORM CONTROL INSTRUCTED INSTRUCTED CONTR 
Diseards from (104) 268) vs. vs 
Control Group NORM NORM 
Diff, Diff 
Mean Gain S.E.* Mean Gain MeanGain SE. SD. 
diff. dif 
Reading 22.1 1.47 24.0 2.24 20.4 1.48 3.52 7 
Arithmetic 23.7 1.39 25.5 2.54 29.1 1.25 2.87 62 
Spelling = 22.2 1.22 17.2 2.02 23.0 3.73 .39 2.12 
Educationsa 
Achievement 20.1 1.10 20.2 1.65 4.8 1.02 3.17 05 
*Uncorrected for correlation. 
A criticism against the conelusion that the health instrueted pupils 
actually improved more in their school work than pupils outside of th: 
experiment is that the former were very probably more intelligent thar 
the latter and therefore should have surpassed the latter’s level of attai 
ment. The health instructed pupils were 4.4 educational months mor | 
mature at the initial test and 9.2 months at the third test than the dis 
Wil 


eards. Differences in learning capacity would have a cumulative effect 
on the school data but it is not likely that they could account for this 
marked difference in educational maturity at the final test between t 
instrueted pupils and the discards. Results previously mentioned bx 
on this point. It has been shown that when the health-trained pupils 
and their control were of the same age and were equally bright a1 
equally suecessful on the first educational test, that the health-trained 
pupils tended to show the larger gains in all school subjects. In genera! 
achievement it could be said that the chances of a true difference we! 


irr 
+} 
the 
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than 99 to 1. The present analyses have indicated that the con- 
roup gained during this period at a rate similar to that of their 
tates who had no eontacts with the health program. It would, 
ore, follow that the comparisons of the instructed pupils with the 
rds ean be interpreted in the same way as the results from the 
icted versus the control when variations in I.Q. were eliminated. 

m these findings it would seem unlikely that slightly higher intelli- 

ratings could account for the marked difference between the gains 

e health instructed pupils and the discards. The inference is that 

ticipation in the health program was an influential factor in the 
rovement in school achievement. 

Further evidence of the influence of the health projects upon edu- 
cational achievement was revealed in the results relative to variations 
n the extensiveness of the pupils’ contacts with the general program. 
Five gradations were contrasted. These ranged from no direct contacts 

iny type to a very broad health education schedule as follows: 

|. Classmates of the control group who had no special contacts with 

any phase of the health work. 

2 The control pupils who had a regular program of examinations 

and interviews. 

;. Classmates of the experimental group who took part in the health 

instruction projects. 

4. Children who transferred from the instructed to the control or 

vice versa, thus having a schedule of examinations, interviews, and 

a portion of the class instruction. 

5. The group who had the complete program of examinations, inter- 
views and health instruction. 

The amount of gain in test scores during the period covered by this 
study is presented in Figure IT in terms of the educational ages at the 
time of the school tests according to the extensiveness of the contacts 
with the health educational activities. These data are from the total groups 

respective of their initial standing. It is apparent from the graph that 
the gains made by the pupils participating in the classroom instruction 
were larger than those made by the non-participants. The chances were 
better than 90 in 100 that the pupils who took some part in the health 
jeets conducted in the classrooms, whether they completed the schedule 
had only two semesters of it, showed greater progress in their school 

k than those who had no contacts with the instruction. A true differ- 

e was established between pupils who had extensive contacts with the 
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health program and those who had very limited or no direct contacts 
with the program. 


beh ive health program 


(Experimental group) 


xx >, Limited contacts with all 
Y GROUPS 1 
Y 
ai VZZA4 projects in the classroor fel 
e Diseards from experimental ¢ 
evs 
15 y. rly examinations and inter 
INSTRUCTED 
A /, a { Dis m control grou; 
54 x 
0 Exten- Trar No No 
sive fers Ir In Con 
I struc str tacts 
tion tion 


Ficgtre Il: Scnoo. IMPROVEMENT AS RELATED TO EXTENSIVENESS OF THE 
HEALTH PROGRAM 


Teaching of health topies when combined with other types of healt 
education appeared to be a greater stimulus than the instruction projects 
alone, although the differences were never large. The group who par- 
ticipated in a portion of the instruction schedule and who also had annua! 
conferences with a physician, a health education specialist, and a ps\ 
chologist, tended to make larger gains than a group who had only th: 
classroom instruction. They, in turn, were exceeded by pupils who had 
the complete teaching schedule and regular interviews with the specialists 

The fact that group differences occurred does not establish a relatior 
to the health edueation projects. It is possible that some special dis 
similarities in the home background of the groups may have been large! 
responsible for the variation discovered. The factors which have bee 
eliminated from the comparative results thus far have been those close): 
associated with the testing situation. Educational accomplishment is : 
complex problem involving the interaction of numerous conditions. An) 
attempt to isolate these conditions will, of course, tend to distort the t 
pattern but at the same time it will provide a check on the trend of ‘1 


( 
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comparative findings. Certain environmental and social condi- 


—— vere singled out for special study in this connection. These in- 
nationality, socio-economic level and cultural background of the 
the type of activities which engaged the child’s out-of-school 

_and his general attitude toward school work. 

\CHIEVEMENT DURING THE HEALTH PROGRAM WHEN THE GROUPS 
on WERE EQUATED WITH RESPECT TO GENERAL BACKGROUND 
\ eareful examination of the comparative findings when several dif- 

— ferent measures of home condition were utilized in equating the groups 

7 ealed no exceptions to the general trend previously established. The 

-“ nerements of educational improvement were higher for the health in- 

structed pupils than for the control pupils who were of like ages, intelli- 
gence, edueational status, and home background. Table V briefly sum- 

/. s the results when the comparisons were based on pupils: (1) whose 

nts were native born and in whose homes English was used exelu- 

2) whose fathers were engaged in similar types of occupations 

s judged by Barr’s seale of occupational intelligence; (3) whose mothers 
ad similar amounts of formal schooling; and, (4) whose homes 

were equally satisfactory with respect to material advantages. In every 

- nparison the health instructed pupils, on the average, were found to 

a somewhat higher rate of achievement, according to standard school 
ealt tests, than the control pupils. 

jects 

TABLE V 
ee IMPROVEMENT AND HEALTH EDUCATION WHEN TIIE GROUPS WERE EQUATED 
- Monthly Increment of Educational Improvement 
ps} rs Controlled Health Instructed Control 

> the N Mean N Mean 

had y, age, I. Q., and E. Q . 122 1.09 40 92 

: cupational status, pupil age, I.Q., and E.Q. 160 1.03 63 26 
lists chooling, pupil age, I. Q., and E. Q 147 1.02 58 95 
atior ng, age, I. Q., and E. Q. 135 1.04 52 96 
ais 

welt The activities which consume the child’s out-of-school hours may 

be rve to retard or to stimulate his general educational development. Par- 

sel t irly would this be noted if the child was fatigued and over-stimulated 
is o many interests or if through materials handled and the training 

An ed he gained special practice in the type of abilities and informa- 


otal neasured by the tests. Inspection of the yearly records collected 


j 
he 
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from these pupils indicated that the groups were similar with respect ; 
their play interests, their membership in organizations, the time give: 
to leisure-time reading, and the frequency of attendance at the movies 
None of the measures of interest in out-of-school activities appeared { 
be significantly related to pupil achievement. Among the populatic 
surveyed the highest coefficient of correlation for these activities 
relation to educational accomplishment was found with respect to extent 
of leisure-time reading, in which r was only .29 + .03. 

One aspect of the reading data merits attention here. The most strik 
ing difference between the interests of the two groups was noted in thy 
case of the amount of reading done by the girls in the health instructed 
classes. In the growth analyses (both mental and educational) the gir! 
showed regular and consistent differences over their control while 1 
boys in certain tests tended to be somewhat erratic. A connection | 
tween the reading and growth findings might be suggested were it not 
for the fact that the health instrueted boys made larger gains on tests 
than the girls. Among the pupils participating in the health projects 
there were twice as many girls as boys who reported a large amount o! 
leisure-time reading but on tests of reading facility and general scho 
achievement the girls did not show as rapid progress as the boys, althoug 
they were equally bright. Thus there was no indication that reading 
interests operated to the advantage of the health instructed pupils. 

A detailed inspection of the data on school attitudes likewise yield 
no evidence of the influence of variations in pupil habits and attitudes 
on the observed group differences in school improvement. Differences 
in such personal attitudes as industriousness, codperation, and persist- 
ence, as rated by the teachers during the period of the investigation, and 
in the general descriptions of their reaction time, as given by teacher 
and by the physician, appeared to be relatively independent of the test 


results. 
SUMMARY AND GENERAL CONCLUSIONS 


The 409 elementary sehool pupils ineluded in this investigation wet 
all physically able to be in regular attendance and could be said to fort 
a representative sample of an average elementary school populat 
Their rate of educational development should have approximated 
reported age and grade norms. On standardized tests participants in 1 
health edueation projects exceeded the grade standards and one ea 
reasonably confident that these pupils were accomplishing more than is 
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nly expected of the average pupil in his progress through the inter- 
te grades. The non-participants while up to standard gave no 
ion of an accelerated rate of achievement. 
consistency of the findings when the groups were alike at the 
ing of the study with respect to age, general ability, school achieve- 
practice in the testing situation, and with respect to many aspects 
me baekground and the general character of their school reactions, 
| seem to warrant the conclusion that the health education program, 
e whole, had a stimulating effect on school achievement. However, 
is no evidence that it was the health content of the teaching projects 
resulted in the improvement. The entire set-up of the investiga- 
especially the phases involving conferences with teachers, principals, 


irents, very likely served as a general incentive influencing teacher- 


ides, methods of teaching, school atmosphere, and, indirectly, indi 
accomplishment. It is believed to be a composite of all these ex- 
‘situations interacting with an improved health regimen and physi- 
maditions—in both of which the instructed pupils showed marked im- 
ement—that was associated with the larger gains in educational 
evement of the pupils who received special heaith instruction. 
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THE COMPUTATIONAL ARITHMETIC OF SOCIAL EXPERI. 
ENCES OF THIRD GRADE CHILDREN 


Essa L. WAHLSTROM 
Ohio University 

‘‘What arithmetie shall we teach?’’ This was the question 
Wilson’ endeavored to answer in 1919. To do this he employed t! 
school-pupil-survey method, i.e., the children were asked to report 
the teachers problems confronting their parents in actual situations | 
everyday life. The findings indicated that the computations of 1! 
average adult were relatively simple. This fact was corroborated ly 
similar studies made in Marshalltown, Iowa, in Boston, and in Melros 
Massachusetts. 

Little has been done in the field of children’s problems. By t 
means of personal interviews, Noon? endeavored to discover what a1 
metical situations were encountered by boys in the intermediate grade 
of the Harry L. Pieree School of Boston. The technique of Smith 
her study of first grade children’s problems was of the same type. Fi 
hundred first graders in the schools of Detroit were questioned 
cerning their activities into which numbers or arithmetic entered 

The purpose of this study was to determine, in so far as it was 
sible to do so, the computational arithmetic involved in the every d 
experiences of third grade children. The investigation was conduct 
during the years 1930-1932 at the Arithmetie Research Laborator: 
lowa State University. The procedure followed the same general | 
as was used by Wilson in his pioneer study. The services of thirty 
third grade teachers were secured. A fairly representative sampling | 
problems was obtained as the schools were located in the states 
Louisiana, Oklahoma, Illinois, Iowa, Nebraska, Massachusetts, Penns 
vania, and New York. Three kinds of schools participated: pub! 
parochial, and teachers college training schools. 

The children were requested to report orally to the teachers { 
own actual experiences which involved arithmetical computations. T! 


were stated in the form of problems and were recorded verbatim 


* Wilson, G. M. A Survey of Social and Business Usages of Arithmetic, Cont: 
tions to Education No, 100, Teachers College, Columbia University, 1919 

7 Noon, Philo G. ‘‘The Child’s Use of Numbers,’’ Journal of Educational 
chology, X (November, 1919 » pp. 462-67. 

*Smith, Nila B. ‘‘ The Uses of Arithmetic in the Out of School Life of 
Grade Children,’’ Elementary School Journal, XXIV April, 1924), pp. 621-23 
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PERI to eliminate adult influences, teachers were cautioned not to accept 
ms brought from home in written form. By June i, 1931, 1,687 
ms had been contributed. The investigator felt that these were the 
fide problems met with in the experiences of children, at least 
ir as it is possible to secure such problems. 
Detailed analyses of the problems revealed interesting facts. Which 
the four fundamental processes was used most frequently by these 
OTT . . 
I ren? Wilson discovered that adults employed multiplication more 
IONS . ah 
they did the other processes. Table I shows what this study found 
ee nswer to the above. One notes that addition and subtraction are 
ited 
' ' almost to the exclusion of the other two processes. 
eLTos 
TABLE I 
By t FUNDAMENTAL PROCESSES USED IN THESE PROBLEMS 
Frequency Percentage 
dal Processes Distribution Distribution 
a1 Addition 1005 48.7 
1] Subtraction 796 38.6 
Mi Multiplication 223 10.8 
. Division 40 1.9 
Further consideration of these same data showing the specific abili- 
ay es found in each process, is presented in Table II. Apparently in the 
lus TABLE II 
br SPECIFIC ABILITIES WITHIN EACH OF THE FUNDAMENTAL PROCESSES 
] Process and Frequency Percentage 
Specific Ability Distribution Distribution 
ty 
Addition 
Ing Basic facts (in isolation) 235 23.3 
, Adding by ending 20 11.9 
e 
Single columns 89 8.9 
nns Two or more columns (no carrying) 836 33.4 
nu! Two or more columns (carrying) 213 11.3 
Broken column 112 _11.2 
1005 100.0 
Subtraction 
The Basic facts (in isolation) 152 19.0 
: Harder subtraction (no borrowing) 849 43.8 
, | Harder subtraction (borrowing) _295 37.2 
796 100.0 
nt Multiplication 
Basic facts (in isolation) 164 73.5 
Harder multiplication 59 26.5 
223 100.0 


Division 
Basic facts (in isolation) 
Harder division 


7 
40 00.! 
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actual experiences of these children multiplication and division are en. 
countered mainly as basic facts, in isolation, such as 4 X 3. Additior 
and subtraction function in the harder or more complicated types, 

How difficult are the problems that these children are called upo 
to solve? Table III shows that these children’s actual arithmetical! ex 
periences are very simple. Ninety percent of all addition needed i: 
these problems had but one or two-digit addends, while seventy percent 
had only two addends. Two-thirds of all subtracting done involved on) 
one or two-digit minuends. 


TABLE III 
DIFFICULTY OF FUNDAMENTAL PROCESSES 


Difficulty Frequency Percentage 
Additio 
digit addend 322 
'wo-digit addend 620 61.19 
Three or more 63 6.28 
I'w 703 69.9 
e or m 1 
Subtractiar 
One-digit mir | 2 10.71 
Pwo-digit mir 24 65.99 
T) r more 187 1.0 


Multiplication 
One-digit multiplier 216 96.8 
Two-digit multiplier 7 ‘ 
Division 
One-digit divisor 22 55.0 
['wo-digit divisor (12 included 18 45.0 


A tabulation of the basie facts was also made. The social utility of 
the third grader’s arithmetic, as shown by this study, spreads itself ove 
all the basie facts in addition and subtraction while in multiplicatior 
the facts seem limited to the tables through the fives. 

One step problems, as might be expected, were most common having a 
pereentage frequency of 78.4. Fractions were used sparingly, while d 
nominate numbers featured mainly as names of quantities and measures 


TABLE IV 
AMOUNTS OF UNITED STATES MONEY USED 


Frequency Percentage 

{mount Distribution Distribution 
01 to 25 2380 82.7 
.26 to .50 253 29.6 
51 to 1.00 182 21.3 
1.01 to 4.00 95 11.2 


4.01 and above 45 5.2 
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0 problems contributed, sixty-one percent dealt with United States 
The amounts involved were comparatively small as Table IV 
final consideration was that of the activities which featured in 
everyday experiences of third grade children. Buying had the 
a eX y . . . 
ae st frequency. <A detailed analysis showed that children purchased 
anner and sort of things. It was interesting to note that they 
reent 
‘Bir t more for other people than for themselves. Work situations 
ded selling papers, errands, caring for animals, housework, ete. 
(ames showed an equally great variety. 
TABLE V 
ACTIVITIES AND TOPICS 
Percentage 
Activity Distribution 
Buying 34.66 
Counting 17.07 
Work Situations 11.49 
Games 8.53 
School Activities 9.66 
Amusements, (Shows, Circus, etc.) 4.97 
Gifts 3.49 
Savings and Allowances 2.45 
Winning and Losing Things 1.89 
Understanding of Adult Activities 1.41 
Construction 1.24 
Health 94 
The data obtained from this study reveal departures from current 
' ctices. Some students of the curriculum question the making of a 
rse of study based on the natural social environment of children. 
s of interest, however, to compare the information secured from this 
survey with an Arithmetie course of study suggested by one group of 
tlum makers.* The course, as found in Fourth Yearbook of Su- 
intendence is given below: 
res 


III Grade 


The emphasis in this grade is 

on addition and subtraction. 
|. Addition (primary and deeade through 80) and subtraction (up 
‘rom 18) mastered. Teaching children to check or prove their own 


th Yearbook, Department of Superintendence, National Edueation Associa- 
26. (Chapter on Arithmetic.) 


| 
ia 
iF 
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2. Multiplication to 5 X 5 (31 facts) as time permits. ;, 

3. Counting by 1, 2, 5, and to 100. 

4. Reading and writing numbers up to 1000. 

5. United States money used with decimal point. 

6. Fractions, ¥, 14, 25, 14, 34, used and understood—simple addi- 
tion and subtraction objectively as time permits and needs arise. 

7. Measuring and weighing in units as mentioned in second grad 
with the pound, quart, gallon, or new units. 

8. Life situations in buying. 

Similarities are to be noted. The emphasis placed upon addition and 
subtraction in third grade by these students of the curriculum coincides 
with the emphasis as placed by the result of this survey. The recor 
mendation as to the amount of multiplication also tallies with that 
the children’s use of that process in this set of problems. Practically 1 
division occurred in this study. Neither is division, as division, included 
in this outline for third grade. 

A comparison of the findings of this investigation with present day 
courses of study shows a lack of agreement as to which of the fund 
mental processes receive the predominate stress. If new and recent 
revised editions of Arithmetic texts may be regarded as an index 
what is taught in the third grade, one often finds that a large or ma 
portion of the time is devoted to the processes of multiplication and 
division. The small use made of these processes in this collection « 
problems presents the question as to the reasons for this existing situ 
tion. Three possibilities might be suggested: (a) children may hav 
avoided these types of problems beeause of their difficulty; however 
they were not asked to solve their examples; (b) children may not h 
recognized these situations as problems and if so, they possibly have n 
real need for them at this age level; (¢) children may not have reached 
a stage of development mature enough for solving these types of pro! 
lems, as the processes of multiplication and division may be much mor 
difficult than they have been considered in the past. 

The question of allocation of subject matter on the basis of t! 
child’s needs and maturation rather than on the basis of logical dete: 
mination sanctioned by tradition is one which should be open to a gr 
deal of experimentation and study. May not many of the arithmeti 
functions, which are deemed simple and easy by the adult person, be ‘ 
reverse for the child who has no immediate or constant need for th 
How valid a basis of curriculum making in arithmetie are the current 
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of number that arise in the types of activities in which children now 


rily engage? 

e following are the conclusions to be drawn from this survey: 

These practices exist in regard to the use of the four funda- 

mental processes in the activities of third grade children: 

(a) Addition and subtraction are used almost to the exclusion 
of multiplication and division. 

(b) All types of addition and subtraction were encountered, while 

in multiplication the basie facts in isolation, as 4 X 3, had 

the highest frequency of usage. 

The analysis of the difficulty of the fundamental processes 

as shown by size of the addends, the minuends, the multipliers, 

and the divisors indicated the relative simplicity of these com- 


putations. 

d) The arithmetic of social utility spreads itself over all the 
basie facts in addition and subtraction, while in multiplication 
the facts are limited mainly to the tables through the fives. 

Seventy-eight and four tenth’s percent of the problems required 
but one step in the solution of them. 

Money transactions are highly important in the child’s every day 
experiences even though the denominations used are small. 

The activitiy analysis indicated buying as the one having the 
greatest frequency of occurrence. 

The arithmetie of social experiences of third grade children as 


shown by this survey would possibly suggest further simplifica- 
tion of current practices found existing in the present arithmetic 
curriculum for the third grade. On the other hand the question 
may be raised, should not the school undertake to extend and to 
enrich the number experiences of children? 
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EDITORIAL 


TRAINING FIELD WORKERS AND GRADUATES IN 
METHODS OF RESEARCH 


With respect to providing training in research methodology, ther 


are prevalent in education at least two points of view,—points of view 
that are not necessarily mutually exelusive and often are compleme: 
tary. In the conventional longer established approach to training it 


research the instruetion is supplied through special seminars, the lab 


oratory, and research courses. At times these are supplemented ) 
courses in statisties, measurements, history and survey techniques. B) 
this plan such familiarity with investigational methods as was aequired 
came more or less incidentally through contaet with advanced courses | 
specifie educational areas. All of these avenues offer, of course, ge 
uine possibilities for a functional understanding of research procedur 
though the emphasis may too often have been placed on the results or 
data of the problem investigated to the partial neglect of a real grasp 
of scientific method as a method of problem solving. A second more re 
cently introduced method of training research workers is the introdue 
tory survey course In the Methodology of Educational Research, wl 
may accomnpany or precede the specialized seminar. 

When it is suggested to professors or administrative officers ho! 
ing the earlier point of view that first year graduate students need fai 
broad introductory or orientation training in the methodology of 
search before undertaking one or more specialized courses in researc 
technique or one or more seminars in a limited area of edueation, | 
answer sometimes has been that: (1) not enough material is availa 
for a general course, (2) such a course is not sufficiently specialized 1 
facilitate an attack on definite problems, (3) students ean do such ri 
ing independently for themselves, (4) the professor can give the necessar 
information through conferences with the thesis eandidate. or (5 
search methods can best be illustrated and deseribed in connection ¥ 
other courses,—for example, administration, psychology, and history 
education classes may emphasize respectively the survey, experiment 
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istorieal techniques of investigation. Discussion of these points 
served for later comment in this editorial. 
the general survey course the steps in problem solving and the func- 
relationships between the various investigational approaches ap- 
n a pattern of research methodology, not likely to result from par- 
tion in only one or two specialized research courses or seminars. 
ropriate topies for consideration are: principles and illustrations 
ng with characteristies of scientific method, selection and delimita- 
of the problem, bibliographical and library techniques, the various 
rch procedures or approaches for collecting data, analysis and in- 
retation of data, and the preparation of the research report. It is 
ely appropriate that seminars also cover such a sequence of topies 
conjunetion with the individual problems or theses, provided similar 
ng has not been secured in a general introductory course, with 
ision for placing a comprehensive body of reading materials in the 
of the student as a ready guide and reference work. Whatever 
type of course or seminar in which the worker receives his training 
e methodological steps and relationships of investigational proce- 
the functional or activity approach in connection with a problem 
thesis well may be emphasized rather than to employ a formal text- 
‘ plan with emphasis only on the learning of a body of subject matter. 
To suggest some of the merits of this second plan: (1) the aceumu- 


ted printed material on research methods of the past ten years is ample 


good general course, which may well include an introduction to the 
ture of research; (2) it does not pretend to take the place of other 
cialized courses on research techniques, but enables the student to 
an intelligent choice between such courses in relation to his prob- 
and needs, as well as provides familiarity with a wide range of meth 
some of which are outside the knowledge of the student who has 
en only one or two specialized research courses; (3) the reading and 
of students on general methods of investigation are organized in 
finite, systematic manner rather than left largely to chance; (4) pro- 
ors are relieved of the unnecessary burden of imparting repeatedly 
dividual conferences the information presented in the general course ; 
») the applieations pointed out in the courses dealing with specific 
: of edueation should be more meaningful by reason of the students’ 
eral background in investigational procedures. 
\s a matter of fact, the fundamental principles, relationships, and 


s in research, as represented by the topics suggested above for a gen- 
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eral course, should be understood by all competent educational workers 
in the field or on the campus (whether graduate students, administra 
tors, supervisors, or teachers), if they are to contribute most effective! 
the solution of problems in their respective areas of responsibility: (1 
all as consumers of research seeking to make appropriate applications 
2) many as active participants in the problem-solving approach be. 
cause of the resulting training value and the inereased understanding 
of the educative process; and (3) a limited number of actual producers 
of fundamental research who contribute in some significant way to th: 
existing store of edueational knowledge. The extent to which individu 
workers go beyond the introductory foundational training in methods 
of research into more highly specialized technical courses in resear 
(concerned with a single approach such as a testing, statistical, sury 
historical, experimental, interview, or case procedure ) must be det 
mined by the needs of the given institution, group, individual, or scl. 
system. 


CarRTER V. Goop 
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REVIEWS 


Address all communications relative to book reviews to Editor 
Kai Jensen, University of Wisconsin, Madison, Wisconsin. 


_ CHARLES C., AND VAN VOORHIS, 

R. Statistical Procedures and 
(State Col- 
The School of Education, Penn- 


Vathematical Bases 


a State College, 1935), pp- vii 


s book is printed by the photo-off- 
ss, by which process photographic 
directly 


uve from the 


1 page, and positives from these 
etal plates ;’’ thus the expense of 
ng is avoided. In order to avoid 
en right-hand margin, charac- 


typewritten material, Mr. 


invented a mechanism which 


ll lines the same length. In using 
anism, the typist notes the num- 
* spaces in exeess or deficiency in a 
ne and adjusts the mechanism ac 
before beginning the line. 
ok is an effort ‘‘to take the 
statisties’’ by giving ma- 
| developments ‘‘in such form 
ns who have studied only high 
matics, plus the chapter on 
vith which this book opens, can 
5 unquestionably a definite need 
of this type which presents 
ns in greater detail than is eus- 
more advanced texts so that be- 
students will have convenient 
for learning the mathematical 
ned assumptions behind the form 
nfortunately, however, this book, 


esenting certain derivations very 


eS 


anecurately and clearly, presents others 


which are definitely erroneous. A good 
part of the material is standard elemen- 
tary statistics, such as the presentation of 
mean, mode, median, standard deviation, 
other measures of variability, the Pear- 
son r, the correlation ratio, and methods 
of computing these statistics. This is 
standard material, clearly presented and 
as such calls for no special comment. 
Since the principal emphasis of the work 
is on mathematical bases, the derivations 
presented should be considered in more 
detail. A number of these derivations are 
presented very clearly and accurately, for 
example, the explanation of the con- 


stant e, bi-serial r, and the _ bi-serial 


and tetrachoric r when the central 


portion of the distribution is un 
known, the correction of coefticients of 


broad 


curve fitting by least squares as applied 


correlation for categories, and 


to the straight line, parabola, exponential, 
and Gompertz curves. Correlation theory 
is suitably introduced by a consideration 
of the regression line, The derivations in 
the chapter on correlation are presented 
very clearly and accurately. The chap 
ter on reliability of statistics presents an 
series of standard 


interesting errors: 


first, the simple standard error of a 


statistic: second, the standard error 
of a statistic in the ease of correlated 
sumples matehed on a fallible criterion; 
and third, the standard error of a statis 


tic in the ease of correlated samples 


stra <> 

tions SK 

thods 

lod | 

cho 

| 
133 


13 JOURNAL OF EDUC 


matched on an infallible criterion. These 
formulae are given for the standard error 
of mean, of a standard deviation, and 
if the difference of two means. 
ipter VII, Inferring Coeffi- 


cients of Correlation for Changed Condi- 


a 
The der- 


} 


ations in 


tions, are well presented in ge neral. The 
chapter begins with a derivation of the 
formula for a correlation of sums or av- 


erages From this the S 


pearman-Brown 


the correction for attenuation, 


and the correction for heterogeneity fol 
od | 


low readily. Ag resentation is given 


of partial and multiple correlation al- 
though the more condensed detrimental 
solutions are not ven. The chapter on 


‘urve contains a very good 


derivation of various properties of the 
normal eurve, such as the mean deviation 
»f a portion of a normal distribution, the 


values of B ,, and the inflection points. 

If the standard of clearness and ac- 
curacy shown in the sections mentioned 
hove were maintained throughout, the 
hook would constitute a valuable addition 
to statistics textbooks Unfortunately, 
however, the | k is or ginally set up, 
contained a large number of typographi- 
eal errors, about one hundred and fifty of 


‘rected in supplemen- 


tar four page folder. Copies of the 
} k now sold have had these corrections 
inserted by hand, but in the review copy 
some of these corrections are also faulty. 
In addition, there are still some fifteen 
fairly serious typographical errors in 


formulae or in mathematical symbols in 


text, errors serious enough to 


confuse ‘‘persons who have studied only 


eh school mathematies,’’ such as: x, 
instead of A x, (page 15) ; j (x) dx, in- 
. 
stead of { f X ax, page 27 f (x) 
. 
nstead of f (a page 68 =D and 


=D’, instead of =n and =n’, (page 89); 
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and No’, instead of No*, (page 120 


n, is omitted in formul: 


exponent, 
and 21 on page 246; several tern 


omitted in the formulae on pages 
280. On page 66, in discussing a 

tively skewed distribution, the stats 
is made ‘‘its mean will be larger tha 
median and its mode will tend to li 
tween these two.’’ The statement \ 
be if the 
‘*mode’’ were 

317 we find ‘*L. 


that the parabola seems best to fit 


**median’’ 
On 


L. Thurstone has f 


correct words 


interchanged. 


norms of forty tests and claims this typ 


The { 

used by Thurstone was the hyperbola. 
All 

quite confu 


of 


to be the eurve of learning.’’ 


formulae are whic! 


typed, 


sing 
ing 


particularly in the 
formulae which contain fractional] 
ponents and coefficients, such as the « 


tion for the normal curve and its first 


second derivatives. See pages 23 
awd 


In addition to the errors listed 
alth he 


regarded as typographical err 


ne 


which, to a begin: 


be 


there are also a number of rather 


ising 
ean 
ser 


errors in statistical and mathen 


logic. The authors, for example, ¢ 


sugges 


of 


a much more pr 


kurtosis’’ with ‘‘ variance,’ 


in discussing the coefficient var 


(on page 65) that ** 


ing standard measure of varia 
rr all distributions wo 
Taking 
statement literally would lead one t 


elude that all 


the same variability, which is ob 


comparable fi 


measure of kurtosis.’’ 


the 


normal distributions 
untenable. The derivation of the star 


error of a difference between means 
tains two compensating errors by 1 
of which a correct result is obtained 


two formulae on page 140 should ¢ 
an additional factor <a This error is 


pensated for by the erroneous sul 


1 Sy N on page 141. Actually, as 
ki N 

m rivation is set up, 5S = nt (N-n)! 


e 162 it is assumed that the geo- 


mean of two correlation coefli- 


; substituted for the arith 
nean, but this assumption is not 


In chapter XII, 


rechnique of Controlled Experimen- 


in the derivation. 


we find ‘‘If the tests employed 
w reliabilities, on account of short- 
other limitation, the obtained dif- 


es are smaller than the true ones, 
0). This conelusion is erroneous. 
best assumption to make regarding 
rror is that it is zero, which makes 
ean obtained difference equal to the 
true difference. The obscuring effect 
rs only when the standard error of the 


ences is also considered. <A correc 


an be found by using the true va 
» of the test instead of the observed 


in the formula for the standard 


if a difference. Considering the 
ing effect of the lack of validity 
test, the 


h states 


authors derive a formula 
that the 


1 to the observed 


true difference is 
difference divided 
validity coefficient of the test. This 
generally true but holds only under 
n special assumptions, which are not 


d in the 


derivation. On page 339 the 


rs derive a formula, 

for estimating the correlation be 
two variables from the correlation 
h with a third variable, when the 
uncorrelated 


re entirely except 


their correlation with the third 


le. Their assumption that the vari- 
a single column of differences is 
to the variance of all the differences 
mly if there is zero correlation be- 
the differences and the matching 


ble. The correct formula, = Ty 
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ean readily be derived from the partial 
correlation formula. 

The 
given above would seem to show that the 


examples of uncorrected errors 


book as it stands cannot furnish a safe 
and eonvenient source of derivations for 
persons with only an elementary know! 
edge of statistics and mathematics. If, 
in a future edition, the authors correct 
the errors, the book will then fill a definite 
need in the field of elementary statistics. 
The final formulae given throughout the 
book are correct (except for those cited in 
chapter XII) so that as a source of sta- 
tistical formulae the book is reliable. 
HAROLD GULLIKSEN 


University of Chicago 


Growth 
Lib- 


Phil 


WILLS, ELBERT VAUGHAN. The 
of American Higher Education: 


eral, P) fessional and Technical 


adel phia: Dorrance and Company, 
1936), 225 pp. £2 00, 
Wills’ Growth of American Higher 


brief of the 
various types of higher institutions: co 
lonial, 


technical, teacher-training, women’s, 


Education is a treatment 


state, denominational, professional 
and 
endowed, graduate, urban, and junior col 
lege. The brevity of the discussions may 
be illustrated by reference to the 13-page 
chapter on the higher education of women, 
Woody devoted 


two volumes to this subject. The 


whereas Thomas has 
doeu- 
mentation is light, only some 45 citations 


being made. The bibliography ineludes 


only 44 references, with some significant 
omissions such as Koos’ work on the jun- 
or college and Reeves and Russell’s sur 


liberal 


The book presents a convenient 


veys of denominational and arts 
colleges. 
brief summary or overview of the de- 
velopment of higher education, although 
the treatment is too sketchy to render it 


satisfactory as a textbook or reference 
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» for 
volume Lor 


students of the history of 
education. 

CARTER V. GoopD 
Un ersity of Cin nnatt 
WALLIN, J 


We lad) ustments 


WALLACE. Personality 


and Mental Hygiene 


New York: MeGraw-Hill Book Com- 
pany, 1935), pp. xii + 511. $3.00. 
From first impression to the end of a 

careful reading the numerous personal 


incidents and case presentations caught 
attention. He 
that 


and held the reviewer’s 


is inclined to the opinion time will 
these to be the most useful part, 


e part, of this book. 


prove 
} } 

which is a very lar 

The 


a field in whic! 


author thinks of mental hygiene as 
material from many other 


sciences may be applied. He says that 


for mental hygienic purposes it is neces- 


sary to draw upon psychology, child 
study, education, sociology, psychiatry, 

dicine, and biology. Two problems are 
in the author’s conception involved. One 


of these is the ‘‘ preservation of the men- 


tal health of the individual and of the 


The other is the prevention 


and cure of mental disease. This inclu- 
sion of cure of mental disease as a part 


Many 


So conceived a 


of mental hygiene is noteworthy. 
would not agree to this. 


text on mental hygiene must of necessity 


cover a very wide range of subjects and 


this one is no exception. The subject 
matter includes such diverse fields and 
problems as those of mind-body rela- 


tionship, therapeutics, characteristics of 


the well-adjusted person, content of a 


mental-hygiene program, conditioning, in- 
feriority troubles, value of humor, ra- 


tionalization, regression, day-dreaming, 


hallueination, drives, conflicts, psycho- 
analytic theory, dissociation, control of 
fear. 

The style and organization impressed 


the reviewer as unusually trying. Or- 


[ Vol. 30, 


dinarily an author has a general pattern 


or plan worked out before approa 


the task of aetual composition 


throughuot his presentation this 


dominates. But in this instance the dis 
covery of the author’s plan constit 

for the 
task. 


appears to be a stenographiec report of in 


reviewer a continuously baff 


The style itself varies from w! 


formal presentation to that of car 
And 
In the preface the -author tells 


composition. there is much 
etition. 
his reader that the material of the | 
‘*first appeared in the form of lectures 
. offered both to popular audiences 
and to 


that he was also conscious of the repet 


students. quite evid 


his work for he defends 


that his 


tiousness of 


on the ground students h: 


found the much repetition ‘‘ distinctly 


vantageous.’’ Perhaps those students 


reviewer would 


less of the 


were right but the 


enjoyed repetition ar 


more syste natie organization. He 8 


g 
doubts the wisdom of introducing s 
technical terms as conflict, phobia 
hysteria prior to their definition. 

It is that 
of this there 


behind the writ 
both a | 


evident 


volume was g 
personal experience with human behavior 
problems and a wide knowledge of the lit 


The 


the fruits of 


reader is given richly, 
that 
problems; but 


profitably of that knowledge of the 


erature, 
personal experie! 
with behavior 


erature. There is an extensive bi 
ography at the end, but many allus 
are made in the course of the text t 
work of various persons whose names 
authe 
The bibliography is 
notably defective from the point of \ 
In the 


ing of books the place of publication 


mentioned but quite without 


cating references. 


of the careful bibliographer. 


the name of the publisher and the 1 
ber of pages are omitted. Journal : 


are given without the volume 
These bibliographic imperfec- 
vever, are more likely the fault 
iblisher. When will publishers 


isefulness of such items! 


y curious and unfortunate omis- 
be noted. Speech defects are 

| among the causes of personality 
ts and behavior disturbances. But 
no insightful presentation of the 
of speech defects. Surely a 
hygiene must grow out of an un- 
ng of the nature of the causes 
ntal disturbance. Blindness also 
rs as a cause but of the literature 
iness now so copious nothing is 
The only-child situation is listed 
on factor in the production of 
difficulties. No references in 

t of this contention appear and the 
is left without an introduction to 
ture which is now very useful. In 
esentation of the psychoanalytic 
m of the stages of love develop- 
‘th the narcissistic and the par- 
stages are omitted. Why this 
| be is especially puzzling. Narciss- 
day presented by many psychia- 
s the essential feature of schizoph- 
Elsewhere in the text the author 
makes much of the disturbing 
f parental fixation, hence it must 
he accepts the parental stage 
in the course of normal develop- 


EDMUND 8S. CONKLIN 
University 


Gor, Grecor. Achievement Tests 
Primary School. A Comparative 
with American Tests in Fife. 
ation of the Scottish Council for 
ch in Edueation, No. 6 (London: 

rsity of London Press Ltd., 
pp. xiii + 136. 5 shillings. 
ften hears from the public plat- 

r encounters in professional or 
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popular reading comparisons of the rel- 
ative efficiency of the American and 
European school systems, but rarely do 
those making the comparisons have objec- 
tive facts upon which to base their judg- 
ments. Consequently, educators and the 
professionally-minded public should wel- 
come this volume which presents the re- 
sults obtained from administering Bat- 
tery A of the Public School Achievement 
Tests in the public schools of Fife to 
6,265 pupils whose eleventh birthday fell 
in the session of 1930-31. This battery, 
including tests in reading, arithmetic 
computation, arithmetic reasoning, lan- 
guage usage and spelling, was standard- 
ized for use in America, and, as pointed 
out by the author of the volume, was 
much better suited for use in the Amer- 
ican than in the Scottish schools. But in 
spite of the limitations, the tests were 
given and scored according to the instruc- 
tions designed for use in America. In 
general, the results show that the level 
of achievement for the Fife ‘‘eleven- 
year-olds’’ is sixteen months superior to 
that for children of the same age in the 
publie schools of America. Children in 
Fife are superior on the five tests as fol- 
lows: reading, five months; arithmetic 
computation, twenty months; arithmetic 
reasoning, thirteen months; language 
usage, twenty-four months; _ spelling, 
twenty-nine months. 

In an effort to account for the superi- 
ority of the pupils in the Scottish schools 
the author, after careful and elaborate 
statistical analysis of the results obtained 
from the administration of the tests to 
the eleven-year-olds and from supplemen- 
tary data secured through administering 
other forms of the same tests and the Na- 
tional Intelligence Tests to 1,326 pupils 
fairly equally distributed among ages 7 
to 11, inclusive, in nine representative 
schools of Fife, concludes that there is 


| | 

| 
ting | | 
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substantial evidence to show that the edu- 
cational advantages which the pupils of 
Fife have over the pupils of America at 
eleven years of age is mainly due to their 
enrolment in school. The author 
points out that the pupils of Fife, enter 
ing school at about five years of age, 
attain a level of achievement at the age of 
seven and one-half years which is four- 
teen months above that of the pupils in 
American schools and that they maintain 
this superiority in all subsequent ages. 
He considers such factors as intelligence, 
longer school day and year of the Scot 
tish schools, the quality of the teaching 
staffs and the entering ages of the pupils, 
factor is the 


and decides that the vital 


fifteen months earlier entrance age. 


This volume is worth reading. It is 
well written and presents sound tech 
niques, It contains an excellent discus 


sion of the limitations of the tests and of 


the difficulties involved in the efforts to 
compare standards of achievement based 
ipon tests designed for use in a restricted 
area. The statement of conclusions, how 
ever, constitutes the challenging contribu 


While Ame 


inclined to postpone the teaching of five 


tion rican educators who are 
subjects and processes until greater men 


tal maturity of the pupils is reached 


should give serious consideration to the 
findings, the writer is not alarmed by the 
situation pre sented. He tends to believe 


that superiority may be explained 
through the wider range and polyglot na 
ture of the American pupil population, 
the selection of schools in which the tests 
were standardized, and the differences in 
the emphasis on educational values in the 
schools of the two countries. He believes 
that the present comparisons are interest- 
ing but that much more intensive investi- 
gations must be made before definite con 
clusions ean be established. 

CLIFFORD Woopy 
Vichigan 


ersity of 


[ Vol. 30, No 


UNZICKER, CECELIA 
Nt idy of the 


An Experi 
Effect of the Use 
Typewriter on Beginning Reading. | 
tributions to Education, No. 610 (N 
York: 
ers College, 


1934 


Publications, 


Bureau of 
Columbia Universit 


» pp. vill 95. $1.50. 


During recent years the use of 
typewriter in school work has spread ray 
idly. The tendency to introduce t: 


into the lower levels of the elem 

school has raised the question of its eff 
upon progress in other school subjects 
pecially in reading. In this mon 


the author investigated the ‘‘effeets 
the use of the typewriter on learni: 
read by first grade pupils. ..’’ 
In a carefully planned program 
75 to 90 minut 


perimental group spent 


per week at typing while the « 
group was engaged in regular act 
of the school. The experiment last 
months with two measurements of 
The results showed a 


trend of 


ing’ progress. 
but consistent superiorit 
the typewriter group in all measures 


The differer 


were not statistically significant h« 


reading achievement. 


Analysis revealed that only childrer 


1.Q.’s of less than 90 profited unit 


‘from the typewriter training. The 


no consistent trend at the higher 


of intelligence. The author fails t 
ploy these findings to suggest that 


MLASIS 


consecutive left 
letters 
words might help the dull pupils 


upon the 


emy 
iit 


sequence of individual 
in learning to read. One may s 
question whether the contemporary 
ods of teaching reading are un 
suited to all levels of mental abi 

This monograph has made a wort 
contribution in showing that typil 
not hinder in t 


The 


with larger groups, however, befo 


learning to read 


grade, results should be « 


vocating the introduction of typ 
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primary grades as a general edu- 
policy. 
MILes A. TINKER 
ty of Minnesota 
J. THomas. A Measurement of 
Secondary School as a Part of the 
Environment. Contributions to 
ation No. 647 (New York: Bu- 
of Publications, Teachers College, 
mbia University, 1935), pp. vi + 
$1.50. 
stical technique applied to educa- 
ranization. Seales have been de 
| in recent years for rating edu- 
al organization, of which the Mort- 
e seale for rating elementary 
rganizations is probably the most 
r. The techniques used have, in 
in, been similar to the one used 
by Strayer and Engelhardt in 
g their seales for the measurement 
ol buildings. A recent attempt to 
a rating seale introduces an in- 
ing variation and refinement of 
methods. The author takes a lis¢ 
ective questions intended to cover 
of the factors in a secondary school. 
estions, after going through vari 
ges of refinement, number two hun- 
twenty-nine. These were submitted 
ncipals of selected schools for rat- 
\ preferred answer was selected for 
juestion and each school was scored 
e basis of these preferred answers. 
ndom sample of papers was then 
nd the biserial coefficient of corre- 
between each question and the 
score was computed for all papers 
sample. Similar computations 
ade for three samples for the pur- 
assuring a more suitable scoring 
resulting key was used to score a 
f five hundred papers. From these 
the correlation of each of the ques 
with the total score of the papers 


was obtained. The questions were then 
classified into categories and those with 
biserial correlations of .30 or less were 
dropped. A list of one hundred questions 
survived this elimination process. This 
was used as a long scale for measuring 
secondary schools. A short scale which 
appeared to be about as reliable as the 
long one was subsequently developed. The 
usual methods of testing reliability were 
applied. The correlation between halves 
of the short scale was .89 which became 
.94 when corrected by the Spearman- 
Brown formula. Corresponding correla- 
tions for the long scale were .90 and .95. 
The scales were then tested by distribut- 
ing the scores of five hundred papers on 
the long seale and of six hundred twenty- 
eight papers on the short scale with the 
usual result that both curves approached 
the normal distribution and that large 
schools scored consistently higher than 
small ones. 

As a result of the study the author has 
derived a seale which can lay claim to 
being the most statistically refined of any 
yet derived. The basis of selection of the 
questions was the biserial correlations as 
derived by the aid of Table 3 of Thorn- 
dike’s I.E.R. Statistical Tables, Series 
of 1925 in which ‘‘each entry is the co- 
efficient of correlation corresponding to 
the percent of overlap stated in the same 
line, when the total group displays fail- 
ures and successes in trait 2 in the pro- 
portions stated at the top of the page 
above the entry.’’ To quote Thorndike: 

‘<This table may be used in place of 
the ealeulation of biserial r where the 
percent of failures is between 10 and 90, 
with only slight losses in precision and 
reliability. ... We have not determined 
the unreliability of an r computed by this 
table; but a reasonable procedure will be 
to use 1.3 times the error for biserial r 
as computed by the regular method.’’ 
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That the seale measures whatever it the validity of all of the questions t 
measures reliably there can be little as a complete measure. That is, do 
doubt. Two questions remain: Whether total score of the scale represent a 
or not the assumption underlying the measure of the total environment? 
making of the scales, either in whole or the questions which the aut 
in part, is entirely defensible will be left ‘‘thought’’ were related to the entire sit 
to the judgment of the reader. This as uation sufficiently related to justify t! 


sumption, as stated in the first paragraph use of such scales as dependable I 
of the study, is as follows: ares of a total school of environment 
‘¢As the secondary school is a factor There need be no doubt about their meas 


in the environment of each of the pupils ring parts of this environment. For 


attending it, each of its elements will ex- study to be complete, the judgments 
ercise some influence upon every pupil. Some ten or twelve secondary school ed 
In the study, a number of these elements cational theorists with respect to the t 


have been considered, and from them have 4¥estions raised herewith might be w 


been selected the ones thought to be re- obtaining. The author has produce 
lated to the entire situation.’’ The sec- meritorious scale which can be used 
ond question which each reader must also compare high schools in certain reg 

answer for himself as he carefully reads “Henever such comparisons appear to | 
the one hundred questions, relates to the needed. J. M. Hue 


validity of each of the questions and to Northwestern University 


ya 

aM 

aN 

| 


Wisconsin. 


BULLETINS 
FowLer D., er. AL. Abstracts 
s At the St. Louis Meeting, 
_ Yearbook XXIV of The National 
Society of College Teachers of Edu- 
Chicago: The University of 
» Press), 64 pp. 
ns summaries of papers relating 
provement of college teaching 
lans for the 1937 Yearbook on 
f background in the interpreta- 


nal issues, 


Gites. A Form 
‘or Thesis Writing (Revised 
n; Los Angeles: University of 
California Press, 1936), 145 


wing the introduction the author 
sses the format of the thesis; ref- 
tables, graphs, and illustrations; 
aids; matters of style; and 


WILLIAM G., AND OTHERS. The 
tion of Teachers Salary Sched- 
Part II: Drafting the Schedule. 
h Bulletin of the National Edu- 
Association, XIV, No. 2 (Wash- 
Research Division of the Na- 


Edueation Association, March, 
pp. 
illetin diseusses such matters as 


tions of salaries, minimum sal- 
ximum salaries, increments, pro 


requirements, sex, teaching 
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aM Address all communications relative to research abstracts and 
ve bibliographies to A. S. Barr, University of Wisconsin, Madison, rod 


xi 


efficiency, and other factors in salary 
schedules; and methods of putting a sal 


ary schedule into operation. 


CHAMBERS, M. M., ET. AL. The Fourth 
Yearbook of School Law, (Washing- 
ton: M. M. Chambers, 744 
Place), 154 pp. 


Contains materials relating to pupils 


Jackson 


teacher certification, con 
loeal school 
the acquisition, use and control 


and parents; 
tracts, ete., teacher tenure; 
officers ; 
of real property; 
tort liability of school districts; 


school contracts; the 
school 
district indebtedness; taxation; and re 


lated topics. 


CRAMER, JOHN FRANCIS, Australian 
Schools Through American Eyes. Edu 
eational Research Series, No. 42 (New 
York: Oxford University Press, 1936), 
59 pp. 

The author gives his impression of the 
Australian schools, discussing the central 
organization and administration, the 
Australian teacher, inspection and super 
vision, secondary education and state ex 
aminations, miscellaneous observations 
and struggles between progress and tra 


dition. 


DOWELL, ANITA SHEMWELL. ‘‘ The Physi 
eal Disability of Teachers in the White 
Elementary Schools of 
Maryland,’’ The John Hopkins Univer 


No. #24, 


Baltimore, 


sity Studies in Education, 


| 

wards 
| 
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(Baltimore: The John Hopkins Press, 

1936), 98 pp. 

After reviewing previous investiga 
tions, stating the problem, and outlining 
the procedure for her investigation, the 
author presents data on the amount, fre 
queney and duration of illness; the re- 
lation of certain factors, such as the 
month of the year, age, salary, ete. to the 
illness; the relation of promotion and 
marital status to illness; conclusions and 
recommendations for further studies. 


Bibliography. 


DUNLAP, WILLIAM C. Quaker Education 
in Baltimore and Virginia Yearly 
Meetings with an Account of Certain 
Meetings of Delaware and the Eastern 
Shore Affiliated with Philade lphia, 

Philadelphia: University of Pennsyl- 
vania, 1936), 574 pp. 

An historical study tracing the origin 
and development of Quaker education in 
Maryland, Virginia, Delaware and ad- 
jacent parts of Pennsylvania, from the 
first settlement of Quakers in the latter 
part of the seventeenth century to the 


present day. 


FARLEY, EUGENE SHEDDEN. A Test of 
Factual Relations in American History 
Philadelphia: The University of 
Pennsylvania, 1935), 145 pp. 
The author discusses the need for such 
a study, the determination of the content 
of the text, objectives of American His 
tory, instruction of the text, standard 
ization of the text and the use of the 
text. Bibliography. 


Heck, ArcH O., AND oTHERS. ‘‘ Pupil 
Personnel, Guidance and Counseling,’’ 
Review of Educational Research, VI, 
No. 2 (Washington: American Edu- 
cational Research Association, April, 


1936), 275 pp. 


Contains summaries of research 


ing to school attendance, school progress 


school marks, recording and report 
characteristics of pupil population, 
ance and counseling, extra-curriculu 
tivities, educational adjustment, s; 


schools and classes and child labor. B 


ography. 


Krey, Aucust C. A City that Art Buil 
(Minnexpolis: The University 
Minnesota Press, 1936), 51 pp. 
This is the second of a series of pul 

cations relating to the Owatonna 

Edueation Project, reviewing the hist 

of the art of Florence and emphasizi: 

how art came into existence out of fun 


mental life needs. 


HERTZBERG, Oscar E., AND MAYER, I 


> 


MEAD. An Analysis of the Report o/ 


the New York State Teacher Train 
Institutions To Improve Their P 
Through Better Selection (Osear | 
Hertzberg, Head of Department 


Psychology, State Teachers Colley 


suffalo, N. Y.), 60 pp. 

The authors discuss the history of 
selective admission program from 
through 1935 in New York state, 
tests applied to freshman and adva 
credit candidates and the results 
tained. 


Simon, DONALD LIONEL. Turnover A 
Teachers in the Small Secor 
Schools of Indiana, (Chicago: 
University of Chicago Press, 19 
157 pp. 

After stating the problem and 
sources and methods of collecting 
mation the author discusses the rat 
turnover and length of tenure, 1 
causes of teacher turnover, turnover: 
professional reasons, turnover for | 
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sons, turnover for personal and 
asons, teacher qualifications and 
er, summary and implications. 


graphy. 


._ CHARLES Epwin. State Control of 


‘he Location, Planning and Erection 


Public School Buildings (Philadel- 
i: The University of Pennsylvania, 
6), 373 pp. 

author discusses the agency of 
l, school building sites, plans and 
fications, bids, contracts, contractors, 
ls, mechanics’ liens, status of the 
tect and similar problems relating 
he location plans and erection of 
lie school buildings. 


UCATIONAL ADMINISTRATION AND 


SUPERVISION 


RSON, Earn W. ‘*‘ Teaching Oppor- 
ities in 1935,’’ Educational Re- 
irch Bulletin (March 18, 1936), pp. 
2-76. 

author presents an annual sum 
y of the teaching opportunities in 
state of Ohio. 


NS, BLANCHE E, AND ATKINS, RUTH 
‘*A Study of the Honesty of Pros- 

etive Teachers,’’ The Elementary 

hool Journal, XXXVI, (April, 1936), 
595-604, 

e author presents the results of an 
mental study of the honesty of 
er’s college students from which 
melude that the proportion of stu- 
who are disltonest in tests is in 
relation to the procedure of the 


er, 


A.S., Jayne, C.D. ‘*The Use 
Sound Recording Equipment in the 
‘udy and Improvement of Teaching,’’ 


The Journal of Experimental Educa- 
tion (March, 1936), pp. 279-287. 


The authors present photographs and 
technical details relative to a sound re 
cording instrument employed by them in 
the study of classroom instruction. 


SmitH, E. L. ‘‘A Critical Analysis of 

Rating Sheets Now in Use for Rating 
Educational Ad- 
ministration and Supervision, XXII 
(March, 1936), pp. 179-189. 


Student-teachers,’’ 


The author presents an analysis of the 
rating sheets used by 103 colleges and 
universities, members of the North Cen- 
tral Association of Secondary Schools 
and Colleges. 


WATKINS, RALPH K. 
of High School Science Teachers in 
Terms of the Market,’’ Science Educa- 


cation (April, 1936), pp. 56-60. 


‘*The Preparation 


The author offers data on the patterns 
of science combinations offered in First- 
Class Missouri High Schools for the 
school year, 1934-35, concluding that we 
still continue to train specialist for jobs 


that no longer exist. 


WILKins, Watter L. ‘‘High School 
Achievement of Accelerated Pupils,’’ 
The School Review, (April, 1936), pp. 


268-274. 


The author presents the results from a 
study of 282 accelerated pupils in a mid 
west city, concluding that, when acceler- 
ation is practised wisely, i.e., with care- 
ful individual study including appraisal 
of physical, mental and _ educational 
growth, emotional stability and social ma- 
turity, the results from the standpoint of 
intellectual adjustment of the accelerated 
pupil will, in general, be good. 
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PSYCHOLOGY OF TEACHING AND 


LEARNING 


R., AND PEDERSON, KEN- 
L. ‘fAn Experimental Evalu- 
ation of A Unit Procedure in Teaching 

American History, The School Review 

May, 1936), pp. 362-372. 

From an experimental study of eight 
sections in American History in the high 
school at Hibbing, Minnesota, the authors 
conclude that for the unit plan of instruc- 
tion employed in this experiment in the 
hands of well-trained teachers familiar 
with the plan the results secured are 
superior to those obtained by study-reci- 
tation plan of supervised study when 
measured by the use of objective tests. 


Pratt, CARROLL C, ‘‘ Repetition, Moti- 
vation, Reeall,’’ The British Journal 
of Psychology, XXVI (April, 1936), 
pp. 425-430. 

The author presents the results of an 
experimental study of the presentation 
of a list of 100 two-digit numbers to 
193 students with no repetition, and with 
motivation from which he concludes that 
maximal results are secured when repeti- 
tion is supported by a motivational fac- 


tor. 


SmitH, CHARLES A., AND JENSEN, 
R. ‘‘ Educational, Psychologi- 
eal, and Physiological Factors in Read- 
ing Readiness I, The Elementary 
Sehool Journal, XXXVI (April, 1936), 
pp. 583. 

The first part of a discussion of read- 
ing readiness: the problem, present prac- 
tice, and psychological factors. Bibliog- 


raphy. 


Watcort, Frep G. ‘‘New Methods and 
Objectives in Teaching Dull-normal 


Pupils to Read,’’ The School k 
May, 1936), pp. 348-362. 


The author presents the result o/ 
experimental studies of the teaching 
reading to pupils of normal and less 
normal ability from which he con 
that our present theories and pr: 
will need to be frequently modified 
effective classroom instruction of 
of this type. 


WALKER, HELEN M. ‘‘ Needed Im; 
ment in the Teaching of Statistics 
Teachers College Record (April, 193 
pp. 607-618. 

The author discusses the planning 
statistical courses for students at vari 
levels; improving the teaching: st 
tical vocabulary content, clarification 
concepts, laboratory work, ete. 


NEW TESTS 
ELWELL, FAYETTE H., AND FOWLK 
JOHN Guy. Instructional Tests 
Bookkeeping (World Book Co., 19 
91 pp. 


The authors present a series of eight 


tests to be employed in the teaching 
bookkeeping at the high school and « 
lege levels. 


LEITER, RUSSELL G., AND PORTEUS, § 
LEY D. The Leiter International | 
formance Scale, University of Ha 
Research Publications, No. 13 (H 
lulu: University of Hawaii, 1936 

The authors present a descriptior 


and data relative to the Leiter Inte: 


national Performance Scale. One of 
most distinctive features is the fact | 
neither verbal instructions nor panto! 
are necessary in applying the tests. 
has been standardized for different 
tural groups. 


L. L., AND THURSTONE, 
1A G. **The 1935 Psychological 
ition,’’ The Educational Rec- 
\pril, 1936), pp. 296-318. 
Ss ulation of the results from the 
n ion of the American Council 
vieal Examination for 266 col 
fie 58,402 students. 
T. L., AND OTHERS. The 
. Plane Geometry Test, the 
= sin Algebra Test, the Wisconsin 
i} 
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Biology Test, the Wisconsin General 
Science Test, the Wisconsin American 
History, and the Wisconsin Language 
Usage Test, (E. M. Hale and Co., 


1936). 


A series of achievement tests employed 
us a part of the statewide testing pro 
gram carried on jointly by the School of 
Education, the Department of Mathe 
matics of the University of Wisconsin 
and the Wisconsin State Department of 
Public Instruction. 
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& Address all research news and communications to Carter V, ¥ 
ye Good, Teachers College, University of Cincinnati, Cineinnati, se 
ye Ohio. 


Vineland Research. 
at the 


The research pro 


gram Training School, Vineland, 


New Jersey, during 1934-35 has been in 
three major directions, namely, (1) the 
development of a seale for the measure 
ment of social maturity, (2) the organi 


zation of a group of studies in the field 
of physiological psychology, and (3) the 
continuing evaluation of clinical case 
studies and case work. The director of 


research is Edgar A. Doll. 


Kansas. 


Kansas, 


at 
schools of P 


Reorganization Parsons, 


The publie arsons, 


are this year operating on what is known 
as the ‘‘six-four-four’’ plan of organi 
zation. The new step in organization was 


hool in Septem- 
administrative staff 
Rees H. Hughes 

toward it for several 
and after the board of 
1935 had given formal approval 
The 
six-year elementary 
high 


senior high school, 


aken at the opening of se 


after the 


ber, 19535, 
under 
had 


years 


Superintendent 
been looking 
education 
early in 
system for a number of 


to the plan. 
years had schools, 


three-grade j schools, a three 


unior 


grade and a two-vear 


junior college, which was housed with the 
gh school. The six-year elementary 
the 


junior units now in- 


senior hi 
schools remain undisturbed by new ar- 
rang The 


elude Grades VII-X, 


ior high school and junior college are now 


rement. two 


and the former sen 


combined into a single junior-college unit 
including Grades XI-XIV. 


was instituted to afford a better service to 


The new plan 


the youth of the city through a simplifica- 


146 


tion of or 
both 


ganization, a 
high school 


n improved continuity 


junior and jur 


lege units, a 


curriculum, and improved art 


within the whole system. 


In putt 
effect, 


being 


reorganization into 


school authorities are 


strengthe 


the 


by Leonard V. Koos of the Univer 
Chicago, long a student and advo 
both junior high school and the 


college. 


A series of 
fiscal, adn 


Wisconsin Studies. 


is being made of the 


tive, and attendance 


units of the s 


of publie education in Wisconsin, by 


Fowlkes of the University of Wis 
The study of fiseal units inelu 
evaluation of the publie school « 


tion fund law under which approx 


83 percent of all publie school fu 
distributed, 

The U of W 
School, of which H. H 


the 


niversity isconsi! 


is one of thirty secondary 


carrying on experimentation u! 


auspices of the Progressive Educat 
An 


has been introduced to include on 


sociation. experimental 


of twenty pupils 


In all, 


classes, eight sucl 


upper 


. Ryan is pri 


curt 


from each of the 


are to be started in the experiment 


The 
way that it will be possible to re 


riculum. project is set up i 


eurriculum to eurrent results as 


to results after graduation fro 


school. 
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is of the high school graduates 
x kept in such a way as to throw 
the validity of various items 
etion of college success. 
ber of the high school staff is 
under a subvention from the 
ntral Association in search of an 
to the question: ‘‘Can an ade- 
iy of authentic material be 
use in the secondary school for 
se of showing the actual work- 
ir government—national, state, 
\nother member of the high school 
s working under a subvention from 
th Central Association in the in- 
m of an experimental course in 
n a number of high schools. A 
the plan is the evaluation of re- 
irticularly with respect to the 


pupils who are enrolled in 


of the | 


riculum 


On Intelligence Tests at the Colleae 
For a number of years most of 
freshmen at Bethany College have 
tested by two different intelligence 
Because the data from these tests 

»f interest to others who are work 
testing problems at this level, there 
ted, in the table below, the coeffi- 
correlation between the tests, 

able errors of the coefficients, and 


ans and standard deviations for 


each test. Unfortunately the number of 
cases is not large. 

The tests included are: the American 
Council on Education Psychological Ex 
amination by L. L. and T. G. Thurstone; 
the Ohio State University Psychological 
Examination by H. A. Toops; and the 
Otis Self-Administering Tests of Mental 
Ability, Higher Examination (Form A 
by A. 8. Otis. The results reported here 
are for 1930 to 1935 inelusive. 

This information was provided by 
Forrest H. Kirkpatrick of Bethany Col- 


Secondary School Standards. — More 
than seven hundred collaborators in all 
parts of the country have coéperated in 
the evaluation and constructive criticism 
of checklists developed during recent 
months by the Committee on the Co 
éperative Study of Secondary School 
Standards. These educators include the 
principals of public high schools of var- 
ious types and sizes in every state, head- 
masters of many private and denomina 
tional secondary schools, representatives 
of state departments of education, and 
professors of education in leading schools 
of education. 

Since the executive office of the Co 
Operative Study was opened in Washing- 
ton in September, 1935, the Committee 


has formulated statements of guiding 


TABLE I 


ENTS OF CORRELATION, PRORBARLE 


ERRORS OF THE COEFFICIENTS, NUMBER OF 


CASES INVOLVED IN COrRELATION, AND MEANS AND SIGMAS FOR 
INTELLIGENCE TESTS ADMINISTERED TO BETHANY COLLEGE FRESHMEN 


dle M 8. D Y Variable M 8s. D N r P.I 
x X Y 
\ 45.33 8.26 Thurstone 1935 192.5 9.8 6 75 0301 
81.73 22.9 Thurstone 1935 190.77 19.6 104 
81.84 23.45 Otis 8S. A 45.16 8.24 75 0296 
s 80.816 22.3 Thurstone 1934 179.415 49.2 141 79 045 
5S 80.382 25.1 Thurstone 1933 153.596 69.5 gO S16 02 
7 118.775 38.97 Thurstone 1932 173.03 56.94 93 R7 016 
7 105.91 36.9 Thurstone 1931 149.32 $8.45 107 78 025 
6 139.15 41.325 Thurstone 1930 141.258 50.18 127 796 021 
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principles and tentative checklists cover- 
1400 
These have been distrib- 


ing almost items classified in five 
general areas. 


uted to the collaborators in order to se- 


cure their judgments and constructive 
suggestions for improvement. The five 
areas selected and the number of items 


in each are: the secondary school pupil, 


including articulation, admission, guid- 


anee, and records, 267 items; the sec- 


ondary school staff, including qualifica 
tions, improvement, and conditions of ser- 
220 items; the educational 


vice, pro- 


gram, including curriculum, pupil ac- 
tivities, library, supervision, and instruc 
562 items; and secondary school 


tion, 
administration, ineluding organization, 
business management, and community re- 
lations, 105 items. 

The judgment of the collaborators who 
have studied these checklists is generally 
very favorable, but they have made hun- 
dreds of suggestions for modification and 
improvement before they are willing to 
approve them as entirely satisfactory in- 
evaluation, 

Most of 


however, that 


struments for purposes of 

stimulation, and accreditation. 
the judges seem to feel, 
these proposed instruments, even in their 
present tentative form, look toward much 
valid, 


standards than those now in use in most 


more flexible, and stimulating 
parts of the country. 

A series of six meetings of the General 
Committee of 21 members representing 
the six regional associations of colleges 
and secondary schools of the country was 
held in St. 
meetings of the Department of Superin- 
National Education As 


number of leading educa 


Louis the week preceding the 


tendence of the 
sociation. 
with the 
evaluating the checklists and other ma 


tors met Committee to aid in 
terial prepared to date, and to plan for 
the future activities of the Study. 
Research Division, N.FE.A.—‘‘The evi- 
dence clearly indicates that during the 


[ Vol. 30, No.2 


present school year of 1935-36, progress 
has been made toward restoratior 
readjustment of salaries . . . It 
portant that the present period of s 
adjustment be used to think throug 
whole problem of teachers’ salaries 
mere return to 1929 conditions may 1 
adequate or equitable in 1936.’’ 1 
statement from the foreword to the 
uary and March, 1936, Research Bu 
of the National Education Associati 
dicates the uecessity for careful stud) 
the entire question of equitable sal 
Part one of ‘‘The Preparation of T; 
ers’ Salary Schedules’’ deals with 
ministrative and fact-finding procedur 
Part two is concerned with the proble: 
drafting the schedule. 

The question of an adequate stan 
of living for teachers is closely relat: 
that of equitable salaries. In 1932 
Committee on the Economic Status of 
authorized a 


Teacher study of cost 


living data furnished by teachers 
twelve monthly budget statements. A s 
mary of the findings from 2,566 us 
records was published as the September 
1935, Research Bulletin entitled 
Teacher’s Position.’’ 

The November, 1935, Research Bullet 


on ‘* Better Reading Instruction’’ is 


Economic 


survey of research and also of success 


ful practice. Codperation was obt: 
from two hundred three schools or sec! 
systems in conducting a question: 
study of successful teaching of ele: 
tary school reading. 

The Research Division also assist 
the preparation of the 1935 reports ¢ 
Committee on Tenure for Teachers 
the Committee on Retirement Allowa! 
of the National 


‘<Recent Court Decisions on Teacher 


Edueation Associat 


ure,’? ‘*Teacher Tenure Legislatior 
1935 to Date,’’ and ‘‘ Teacher Retire 
Legislation in 1924 and 1935 to Dat 
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rogress Research Division has also con- Tests,’’ Vol. V, No. 3, June, 1935. 2. 


» cobperate in an editorial and 
tive capacity with regard to the 
ns of certain departments of 
nal Education Association. The 
es. A Studies Curriculum, the 1936 Year- 
not the Department of Superinten- 
s a practical handbook dealing 
e J principles and practices of a 
piogram of social studies. The 
| is divided into three parts: fac- 
ud) nditioning the social studies; the 
la ries studies curriculum; and teaching, 
Te: ting and revising the social studies 
th m. Among-the factors condition- 
“dur ct ocial studies are: the nature of 
lem : the role of education and the 
and the nature of the learner 
learning process. Recognition 
ted th social studies program for the 
ls is a compromise between the com 
nsiveness and specialism of scholar- 
1 the requirements and necessities 
olroom organization and presenta- 
s basie to successful teaching. 
us The Fourteenth Yearbook of the De- 
mber tment of Elementary School Principals 
ed Socializing Experiences in the 
tary School was issued in July, 
The socializing influence of the 
, | may be increased by modifying the 
onal content and methods of teach- 
the regular subjects, and by the 
‘tion or adaptation of a wide va- 
f life-like group activities, such 
bs, assemblies, publications, and 
participation in student manage- 
This yearbook is primarily con- 
with these more informal, life-like, 


rmerly ‘‘extra’’ activities, includ- 
) chapters on the activity program 
perative community activities. 

nt issues of the Review of Educa- 
Research published by the Amer- 
Edueational Research Association 
se these titles: 1. ‘‘ Psychological 


‘‘The School Plant,’’ Vol. V, No. 4, 
October, 1935. 3. ‘‘Educational Tests 
and Their Uses,’’ Vol. 5, No. 5, Decem- 
ber, 1935. 4. ‘‘Mental and Physical De- 
velopment,’’ Vol. VI, No. 1, February, 
1936. 5. ‘*Pupil Personnel, Guidance, 
and Counseling,’’ Vol. VI, No. 2, April, 
1936. 

The Educational Research Service, 
maintained by the Research Division and 
the Department of Superintendence, has 
issued these circulars since June, 1935: 

1. ‘*Edueation Discussed in Lay Mag- 
azines,’’ Circulars 7, 9, and 10 (1935); 
1 and 4 (1936). These five summaries of 
articles in non-educational magazines 
cover the period from April 1, 1935, to 
April 1, 1936. 

2. ‘*Questionnaire Studies Completed 

Bibliography No. 6, 1934-35,’’ Circular 

No. 8, September, 1935. The list of 
thirty-two studies presented in this cir- 
cular is based on questionnaires submitted 
to city and state superintendents of 
schools. 
3. ‘*School Expense Compared with 
Combined City and School Expenses, 
1934,’? Cireular No. 2, February, 1936. 
This circular presents information for the 
ninety-four largest cities on total city and 
present school expense, school expense 
only, cost per capita, and percent the 
school cost is of total expense. 

4. ‘‘Opening and Closing Dates of 
City School Terms, 1935-1936; Dates of 
College Summer Sessions, 1936,’’ Circular 
No. 3, March, 1936. The facts in this cir- 
cular are based on an inquiry sent to the 
three largest school systems in each state 
and the three largest colleges and uni- 
versities in each state which report the 
largest enrolments in summer school. 


Office of Education Projects.—Presi- 
dent Roosevelt has authorized the Office 


| 

| 
| 
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of Education to conduct five projects for 
the advancement of education, financed 
by relief funds and designed to give work 


unem- 


to some 3500 ‘‘white collar’ 
ployed: 

(1) Forums: Authorization for this 
project ($330,000) will permit establish- 
ment of demonstration centers in various 
parts of the country to develop further 
and test the plan for civie education now 
in its fourth year at Des Moines. These 
public forums (ten in all) will be ad 
ministered entirely by local groups, but 
the lessons learned locally will be passed 
on to other communities using this ap 
proach to adult education. The Director 
is Commissioner Studebaker. 

2) Research: Under this project 
needy graduates will engage in coépera 


tive studies of important educational 


problems. Results will be brought to 
gether by the Office of Education for use 
throughout the nation. Appropriation: 
$500,000. Director: Ben W. Frazier of 


the Division of Higher Education. 

3) Voeational Education for Ne- 
groes: There is a great need for facts to 
be used as a basis for improvement of 
Negro education. Studies to be eon 
ducted as part of this project will give a 
better picture of the entire problem of 
educational and vocational opporunities 
for Negroes than we have ever had. Ap 
propriation: $234,000. Director: Am 
brose Caliver, specialist in the education 
of Negroes. 

t) Radio: For the first time a truly 
adequate staff will be made available 
through this project to present a series of 
educational radio programs. Talent se- 
lected from CCC and WPA dramatic 
rolls will staff an edueational radio 
‘*workshop’’ in Washington, D.C. Ap 
propriation: $75,000. Director: William 
Dow Boutwell, Chief of the Editorial Div 


ision. 


(5) Organization of Local Sch 
Units: This project, designed t 
states in planning for more efficient 
district organization, was originally s 


mitted to include 31 states. As 
proved it now includes only 10 states 


propriation: $844,000. Director: Henr 
F. Alves, specialist in state scho 
ministration. 

Assistant Commissioner Bess G 
koontz is in general charge of pr 
Nos. 2, 3, and 5. 

Federal relief funds totaling $1,98 


000 are available for the five projects 


Visual Instruction.—Questionnaires f 
the National Visual Instruction §S 
have been sent to 21,000 city and e 
superintendents of schools and prin 
of private high schools throughout 
United States from the Office of Ed 
tion by Cline M. Koon, Specialist 
Radio and Visual Edueation, and Di: 
tor of the Survey. This survey of vis 
aids used in publie and private sc 
first of its kind ever undertaken on : 
tional scale, is a codperative endear 
the American Council on Edueation 
the United States Office of Educat 
Among other agencies expressing 
proval of the inquiry are the Nat 
Edueation Association, National Cor 
of Parents and Teachers, Rural Elk 
eation Administration, and Divisi 
Motion Pictures, U. 8S. Department of t 
Interior. 

Superintendents and _ principals 
schools quite generally report insuff 
budgetary provisions for visual 
and insufficient training of tea 
in their use. Most visual instr 
tion in schools today, according t 
first few hundred questionnaires retu 
is in geography, history, health, tr 


and safety education, although superit 


tendents and principals report using vis 
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yr teaching economics, English, 
industry, literature, biology, 
rriculture, reading, crafts and 
Use of news reels, feature pic- 
ign language films, and relig- 


ition visual aids were also re- 


tudy will also bring information 


S. Office of Education for the 
on the use of radios, phono- 
i centralized radio-sound equip- 
iblie and private schools. Sug- 
were invited on how national 
an facilitate use of visual aids 
ictional purposes. The replies 
information on the nature 
audio-visual aids, and present 


struction needs of school systems. 


onal Education in Alaska.—The 
ent of Education of Alaska was 
| nineteen years ago, and of 
quite young as compared with 


te or territorial school systems. 


lue to its youth and partly be- 


the few people employed in the 
nt, it has not as yet a depart- 
research and, henee, no scien- 


ies have been made relative to 


nal needs. 
ver, those who have been con- 


vith Alaska’s educational system 


length of time have seen the 
an enlargement of its vocational 
Prior to the present year, work 
offered in some of the larger 


in manual training and home 


es, but this has been vf the old 


! without federal aid. 

ril, 1934, Congress made the pro 
f the George-Ellzey Act applic- 
Alaska, providing $15,000 an- 


for aid in vyoeational education 


the Territory accepted the pro 
f the Act and appropriated a like 
The 1935 Legislature of Alaska 


accepted the provisions; plans were im- 
mediately draw up by the Department, 
and these were approved by the Office 
of Education of the Federal Government. 

One supervisor was employed for the 
three phases of work, namely, home eco- 
nomics, agriculture, and trades and indus- 
tries, with a part-time assistant super- 
visor of home ecenomies. The super 
visor started work in July, 1935, visiting 
school boards and superintendents in all 
the larger cities. 

Due to the fact that teachers had a 
ready been employed for home economies 


and manual training in all the schools, 
not all schools are offering the vocational 
work this year because some of the teach- 
ers so selected could not be approved 
under the adopted plans. However, school 
boards now know the requirements, and 
qualified teachers will be selected here- 
after. 

A good start has been made, however, 
in adult education in nearly all the larger 
cities. Courses have been offered in min- 
ing, marine engineering, navigation, taxi- 
dermy, cooking, sewing, ete. Alaska is 
so rich in its many natural resources that 
it presents a splendid opportunity for in 
struction along these lines. 

The Smith-Hughes Act has never ap 
lied to Alaska, which is the only political 
subdivision of the United States so situ- 
ated. A bill is now before Congress pro- 
viding for the application of this Act 
to Alaska, and there seems every reason 
to believe that it will pass. This will 
give the sum of $15,000 more from the 
Federal Government, and with that ap 
propriated by the Territorial Legislature, 
will make a total of $60,000 available 
for vocational work. 

When this sum is available, special 
supervisors will be appointed in each of 
the three fields of vocational education, 
and instruction will be extended to the 
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older pupils of as many of the seventy- 
five village schools as funds will permit. 

In these rural schools, up to the present 
time, only the usual academic work has 
been offered. Many of these schools are 
quite isolated and few of the parents 
are financially able to send pupils to high 
school, so few ever go farther than the 
eighth grade. 

The plan is to start the vocational work 
in the sixth or seventh grade and to 
ive two or three years of instruction 
along lines which will better fit the girls 
for the work they usually do and offer 
the boys training in the type of work 
which they will follow in their respective 
communities, At the same time, the aca- 
demie work will still be given, so that 
those pupils who ean afford to go farther 
in school work will be adequately pre- 
pared. 

Such a program, it is believed, will be 
of lasting economic benefit to the pupils, 
as well as to the Territory. 

This information was provided by 
Anthony E. Karnes, Commissioner of 
Education, Territory of Alaska. 


Improvement of Instruction in Arkan- 
sas.—The Arkansas Codéperative Pro- 
gram to Improve Instruction is now in 
the third year of a five-year plan. Over 
25,000 teachers and patrons are actually 
participating. The program was initiated 
by the State Department of Education 
and is being directed by a member of 
the Department staff. All teacher-train- 
ing institutions and other educational 
agencies of the state are codperating. 
Doak S. Campbell and Hollis L. Caswell 
of George Peabody College for Teachers 
are acting as general consultants. Spe- 
cial consultants and laboratory assistants 
from various sections of the country have 
been secured to direct certain phases of 
the work. 


Arkansas has 460,000 school childre; 
under the guidance of over 12,000 
ers. The general purpose of th 
gram is to improve the daily prog: 
school life of these pupils and tea 
It is proposed through voluntary ¢ 
tion and extended participation, 
ing all local, county, regional, and 
educational agencies and instituti 
initiate, stimulate, and guide group st 
and classroom experiments in curr 
revision. It is not proposed in an 
to minimize the fundamental role of 
ganized subject matter,’’ but rat! 
vitalize subject-matter and other inst 
tional materials by tying them into 
experiences, interests, and realized 1 
of the pupils. When the purpose of 
program is realized, logically arrar 
subject matter will no longer serve as 
basis for organizing instruction. 

After establishing an administra 
organization designed to utilize all 
able educational agencies, summer 
riculum laboratories were set up at Pi 
body College and the University of Ar 
kansas. Selected leaders under the dir 
tion of general and special consult 
produced bulletin materials for gu 
of teachers and patrons. These ‘‘ 
riculum laboratories’’ have been ¢ 
ducted each summer. Over 200 sel 
teachers have been trained in the p 
ophy, production, and organization of 1 
curriculum materials. More than 
copies of these bulletins have beer 
duced and are now in use through 
state. Tentative principles, aims, s 
and study materials have been set fort 
Thousands of teachers and patror 
scores of local, county, regional, and st 
groups have studied these materials 
new instructional program based or 
experimental point of view is gra 


coming into being. Teachers, pupils 


patrons, from the larger cities t 


| 
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school houses in the moun- 


’? under the stim- 


‘come alive 
this codperative experimental 
With direction from local 
supervision, hundreds of class- 
become ‘‘ little laboratories.’’ 
in ever-increasing numbers are 
om the old page assignment 
w larger units of instruction 
in the interests, experiences, and 
the children. Scores of these 
tered classrooms are going into 
This fine theory is gradually be- 
practical reality in ‘‘key 

’ in all sections of the state. 


\rkansas Congress of Parents and 


is making an outstanding con- 

They have produced 8,000 
two bulletins and have enrolled 
rsons in study, discussion, and 
yups. Their membership has in- 


fifteen to thirty thousand 


this two-year period. More than 


other social and professional 
éperating this year in a study 
anging Attitudes through Adult 

’? Other special features are: 
al curriculum courses are being 
n all approved colleges in the 


2) experimental and demonstra- 


iching is offered in the summer 


hools of these institutions; 
pereent of the 2,000 Negro 

in the state are actively partici- 
t) key schools nave been desig- 
der special supervision, some of 

y problems constantly coming to 
ee are being attacked first by 
hers and schools. No effort is 
hold all schools in the same 
While many schools are in the 
s, others have a well organized 
ler wav. On the whole, ele 
chools develop more rapidly 


lary schools. 


mmarize briefly, an experienced- 


centered curriculum, embracing certain 
principles, aims, and scope is held as a 
tentative hypothesis to guide Arkansas 
teachers in applying the philosophy of 
experimentalism to the _ instructional 
program of more than 12,000 classrooms. 
Purposeful activity is supplanting arbi- 
trary intellectualism. Teachers are get- 
ting away from the idea that it is so 
necessary to give pupils something; they 
are learning to center the instructional 
program within the interests and needs 
of the children, to accept and to have 
faith in the individual capacity for 
growth through natural development. 
Thousands of trained adults and tens of 
thousands of school children are enjoying 
this experiment in improving school life. 
Many problems are yet unsolved, even un- 
discovered, but a newer, better instruc- 
tional program is being wrought out and 
fashioned to meet the changing needs of 
the school children of Arkansas. 

This information was provided by Ed. 
McCuistion, Director of Certification and 
Teacher Training. 


Research in Australia, 1934-85.—The 
activities of the Australian Council for 
Educational Research may be summarized 
as follows: 

1. The Council is the only permanent 
educational establishment in Australia de 
voted to the purely professional interests 
of education and embracing all States. 
It is generally recognized that the great 
est need in Australian education to-day 
is the development of a greater profes- 
sional spirit and status. This requires 
that education should be a progressive 
study. A very substantial contribution 
towards this end can be made by an or 
ganization devoted to the study of edu 
eational trends in various parts of the 
world and having the machinery for 
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supporting inquiry and for initiating ex- 
periments. 
2. Being quite independent of existing 


organizations and having no administra 


tive functions the Council is able to ex- 


press impartial opinions on educational 


problems, The fact that the Council has 


the active support of almost all leading 


educationalists in Australia lends weight 


to those opinions. 


3. During its five years it has sup- 


hundred 


ported over one investigations 
and will shortly have published forty 
reports. Many of these reports have an 


immediate bearing on the practical prob 
Their pub 


lems of the classroom teacher. 


lication cannot but have a marked in 


fluence on Australian education. 
4. The Council is in a position to spon 
Special men- 


of li 


Australia— 


sor surveys and inquiries. 
be of the 


conditions throughout 


survey 


tion must made 
brary 


which is destined to be of his 


a survey 
torical importance in library matters and 
the 


and of the inquiry 


to have reactions 


of 


important 
*hools 


roblems of secondary education 


upon 
the 


work 
into the | 


has 


5. The Council is making good prog- 


which just been opened. 


ress in supplying standardized tests of 


attainment in the chief school subjects as 


well as tests of general intelligence. Aus 
trailia is many years behind in such 
matters. The existence of such tests en- 


ables any 


y teacher to ascertain precisely 
the standards of his pupils and removes 


of the strongest arguments against 


view that school should do most of its 


one 

the 

own examining. 

6. The Council acts as a clearing house 
information on educational develop 

Through the 


national Institute of Intellectual Coépera 


of 


ments. action of the Inter- 


tion the Council is recognized as the na 
tional center in Australia for the provis 
ion of educational information. Ex- 
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changes of information and of pu 


[ Vol. 80, No 


tions are maintained between the Coun 


and a number of similar centers in ot} 
status of t! 


parts of the world. The 


Council in these matters is recognized 
of the 


officials Commonwealth 


Gover: 


ment and of the State Education Depart 


ments. 
7. Owing to its relationships with o\ 


seas centers the Council is able to 


and advise teachers and administrat 
going abroad. It has also been inst 
mental in arranging for a numbe 
Australian educationalists to rec 


grants for traveling purposes from t 


Carnegie Corporation of New York. 
8. The Council maintains a library 

books which is freely 

Some of these | 


other libraries 


educational 
able to all teachers. 


are not available in 


Australia. Special attention is paid 


expensive books of a technical character 


At present the library contains about § 


of which 


eighth are on loan to teachers at 


volumes, approximately 
given time. 
9. The chief educational journals | 


lished 


ceived and a card-index record is kept 


in the English language ar 


important articles appearing in t! 


This makes it possible to provide help t 
of 


number inquirers who wish to 


theses, prepare papers, or give add 


at teachers’ meetings and confer 
10. The Council has in hand ar 
ments for a conference on education 


Australia in 1937 under the auspi 
the New Education 
land). This 


speakers from overseas, is likely to 


conference, with le: 
most important event of the kind 
has so far taken place in Australia 
11, 
the Council 


Among the practical matters 
or its workers 
gated since its inception may be 


tioned: the curriculum of the pr 


Fellowship Er 


have i st 


4 
as 
4 
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he use of tests for predicting 
iecess; defects of speech in 
iildren; color blindness; the 

capacity of various occupa- 
e length of the teacher’s profes- 
the best methods of revision 


fe: 


1 work; juvenile delinquency; 

of school broadeasting; the 
p system in Victoria (to be pub- 
ortly); the teaching of history 
s; class groupings; and educa- 
retarded children. 


ver, the Council has not sought 


rily to centralize or to control re- 


{ 


It is a scientific society, work- 
odperative basis with state edu- 
authorities, but independent of 
he investigations are conducted 
viduals and committees whose 
re co-ordinated and supported 
yunceil, 
‘ouncil planned to test in March, 
out 30,000 children in Australia 
the ages of nine and fourteen. 


the tests used was the Otis Self- 


stering Test of Intelligence. The 


iland Council for Educational Re- 
s planned a similar program of 
ent, Seotland has tested practi- 
ry child in its territory between 
1 11% years of age. 
wd Studies—P. Davidson 
D. Anderson have zompleted a 
the ‘Occupational Mohility in 
rican Community,’’ in which the 
sties of a seven percent sample 


ale working population of San 


‘alifornia, were analyzed. The 


relate to degree of occupational 
ce and mobility, juvenile jobs, 
to permanent occupation, indi 
vement in occupational status 
r, schooling, income, marital con- 


pendeney, displacement, unem- 


ete. 


G. N. Kefauver and H. C. Hand have 
completed ‘‘An Appraisal of Guidance 


’ which is to be 


in Secondary Schools’ 
published by Macmillan during the cur- 
rent year. Different aspects of the de- 
velopment of pupils in ten cities were 
measured. The findings show variation in 
the status of pupils from city to city, with 
a relationship to the emphasis in the guid 
ance program. The status of pupils and 
the guidance program were not satisfac- 
tory in all respects for any of the cities 


studied. 


Comprehensive Examinations the 
Chicago Junior Colleges—Courses in 
English, composition, biological science, 
the humanities, physical science, and 
social science constitute the required por- 
tion of the curriculum of the three Chi- 
eago municipal junior colleges. The 
typical freshman studies English, com 
position, the first year of social science, 
biological science or physical science, and 
a number of elective courses. The typical 
sophomore enrolls in the humanities, bio 
logical science or physical science, the 
second year of social science, and several 
elective courses. The achievements of 
the students enrolled in the required 
courses named sbove are measured by 
comprehensive examinations prepared by 
the Department of Examinations, with 
the assistance of the faculties concerned. 
Each of these examinations is designed to 
cover one full year of study. The scores 
and marks are used in determining 
eligibility for graduation. They are also 
used to provide data on which to base 
recommendations of students to higher in 
stitutions, and to provide information 
useful in educational and _ vocational 
counseling. Ultimately, six comprehen- 
sive examinations, corresponding to the 
courses named, will be given each semes- 


ter. No examination for the second-year 
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course in social science was necessary in 
June, 1935. 

The following topics are considered in 
a report describing the 1935 examina 
tions, prepared by M. D. Engelhart: (1 
the preparation of the examinations; (2) 
the administration; (3) the scoring; 
(4) the D-seore; (5) the assignment of 
letter grades; (6) the distributions of 
original scores, D-scores, and _ letter 
grades; (7) the reliability of the ex- 
aminations; and (8) the analysis of the 


achievement of the ‘‘average’’ student. 
The report concludes with some inferences 
derived from the data and with some ree- 
ommendations based upon these infer- 


ences. 


Iowa Testing Program.—For a long 
time a number of educational workers 
have felt the need of types of appraisal 
of instruction which give an adequate pic- 
ture of what is being accomplished, which 
show deficiencies wherever they may exist, 
and which afford data that may readily 
be made the basis for a progrem of im- 
provement. It is claimed that, under the 
direction of E. F. Lindquist and with the 


[ Vol. 80, Nog 
codperation of the staff of the College of 
Education, University of Iowa, such 
battery of tests has been develop 

For the past eight years the ¢ illeg 
of Edueation and the Extension Divisio; 
have provided a cooperative regional test 
ing service known as the Every Puy 
Testing Program. One of the most im 
portant outgrowths of this experience has 
been the development of a comprehensive 
battery of tests of the basic skills 
reading, study, language, and arithmeti 
for grades six to eight. The second 
(1936) edition of these tests was given t 
over 40,000 students in January, 1936 

It has been decided to release the tests 
for nation-wide use, independent of th 
organized program, after norms have bee 
established on the basis of the results of 
that program. 

It is said that the whole project is 
being conducted on a strictly non-cor 
mercial basis with no royalties being paid 
All proceeds from the sale of the tests 
will be devoted to research and experi 


mentation for the future production of 
improved materials and service. 
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